Sep 28 12:04:04 devstack cinder-volume[76023]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 12:04:04 devstack cinder-volume[76023]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 12:04:04 devstack cinder-volume[76023]: we strongly recommend against using it for new projects. Sep 28 12:04:04 devstack cinder-volume[76023]: If you are already using Eventlet, we recommend migrating to a different Sep 28 12:04:04 devstack cinder-volume[76023]: framework. For more detail see Sep 28 12:04:04 devstack cinder-volume[76023]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 12:04:04 devstack cinder-volume[76023]: import eventlet # noqa Sep 28 12:04:07 devstack cinder-volume[76023]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:04:07 devstack cinder-volume[76023]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:04:07 devstack cinder-volume[76023]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:04:08 devstack cinder-volume[76023]: INFO dbcounter [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Registered counter for database cinder Sep 28 12:04:08 devstack cinder-volume[76023]: DEBUG oslo_db.sqlalchemy.engines [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:04:08 devstack cinder-volume[76023]: DEBUG dbcounter [-] [76023] Writer thread running {{(pid=76023) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:04:08 devstack cinder-volume[76023]: INFO cinder.rpc [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 12:04:08 devstack cinder-volume[76023]: INFO cinder.rpc [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 12:04:08 devstack cinder-volume[76023]: DEBUG oslo_db.sqlalchemy.engines [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:04:08 devstack cinder-volume[76023]: INFO cinder.volume.manager [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Determined volume DB was empty at startup. Sep 28 12:04:08 devstack cinder-volume[76023]: DEBUG cinder.volume.manager [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76023) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 12:04:08 devstack cinder-volume[76023]: INFO cinder.volume.manager [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 12:04:08 devstack cinder-volume[76023]: WARNING stevedore.named [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 12:04:08 devstack cinder-volume[76023]: WARNING castellan.key_manager [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:04:08 devstack cinder-volume[76023]: WARNING cinder.keymgr.conf_key_mgr [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:04:08 devstack cinder-volume[76023]: DEBUG cinder.volume.drivers.lvm [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76023) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_concurrency.processutils [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76023) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_concurrency.processutils [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] CMD "cinder-rtstool verify" returned: 0 in 0.449s {{(pid=76023) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_db.sqlalchemy.engines [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:04:09 devstack cinder-volume[76023]: INFO cinder.rpc [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 12:04:09 devstack cinder-volume[76023]: INFO cinder.rpc [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 12:04:09 devstack cinder-volume[76023]: WARNING stevedore.named [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 12:04:09 devstack cinder-volume[76023]: WARNING castellan.key_manager [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:04:09 devstack cinder-volume[76023]: INFO cinder.volume.manager [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_db.sqlalchemy.engines [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76023) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:04:09 devstack cinder-volume[76023]: INFO oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Starting 1 workers Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Started child 76187 {{(pid=76023) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Full set of CONF: {{(pid=76023) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] ******************************************************************************** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Configuration options gathered from: {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] ================================================================================ {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] allow_availability_zone_fallback = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76187]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] allow_compression_on_image_upload = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] allowed_direct_url_schemes = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] api_rate_limit = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] auth_strategy = keystone {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] az_cache_duration = 3600 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_availability_zone = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_host = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_stats_polling_interval = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backup_api_class = cinder.backup.api.API {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backup_name_template = backup-%s {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backup_use_same_host = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backup_use_temp_snapshot = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] chap_password = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] chap_username = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_internal_tenant_project_id = debad409a10141b8a86aaffcfeab3a67 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_internal_tenant_user_id = 06b7d8d002d8410d902133dba51861c1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cloned_volume_same_az = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cluster = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] compression_format = gzip {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] compute_api_class = cinder.compute.nova.API {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] config_dir = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] config_source = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] control_exchange = openstack {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] debug = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] default_availability_zone = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] default_group_type = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] default_volume_type = lvmdriver-1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] disk_geometry = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] driver_client_cert = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] driver_client_cert_key = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] driver_data_namespace = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] driver_ssl_cert_path = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] driver_ssl_cert_verify = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] driver_use_ssl = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] enable_force_upload = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] enable_new_services = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] enable_unsupported_driver = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] enforce_multipath_for_image_xfer = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] filter_function = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_api_insecure = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_api_servers = ['http://192.168.122.157/image'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_api_ssl_compression = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_ca_certificates_file = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_catalog_info = image:glance:publicURL {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_certfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_keyfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_num_retries = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance_request_timeout = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] goodness_function = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] graceful_shutdown_timeout = 5 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] group_api_class = cinder.group.api.API {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] host = devstack {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_compress_on_upload = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_conversion_address_space_limit = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_conversion_cpu_limit = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_conversion_disable = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_introspection_address_space_limit = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_introspection_cpu_limit = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_upload_use_cinder_backend = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_upload_use_internal_tenant = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_volume_cache_enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_volume_cache_max_count = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76187]: INFO cinder.volume.manager [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] image_volume_cache_max_size_gb = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] init_host_max_objects_retrieval = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] instance_format = [instance: %(uuid)s] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] iscsi_target_flags = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] iscsi_write_cache = on {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] iser_helper = tgtadm {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] iser_ip_address = 192.168.122.157 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] iser_port = 3260 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_color = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_config_append = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_dir = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_file = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_options = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_rotate_interval = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_rotate_interval_type = days {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] log_rotation_type = none {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] max_age = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] max_logfile_count = 30 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] max_logfile_size_mb = 200 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] max_over_subscription_ratio = 20.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] message_reap_interval = 86400 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] message_ttl = 2592000 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] migration_create_volume_timeout_secs = 300 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] monkey_patch = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] monkey_patch_modules = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] my_ip = 192.168.122.157 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] no_snapshot_gb_quota = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] num_iser_scan_tries = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] num_shell_tries = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] num_volume_device_scan_tries = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] nvmeof_conn_info_version = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] nvmet_ns_id = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] nvmet_port_id = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] osapi_max_limit = 1000 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] osapi_volume_ext_list = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] osapi_volume_listen_port = 8776 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] osapi_volume_use_ssl = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] osapi_volume_workers = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] per_volume_size_limit = -1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] periodic_fuzzy_delay = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] periodic_interval = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] public_endpoint = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] publish_errors = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] quota_backup_gigabytes = 1000 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] quota_backups = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] quota_gigabytes = 1000 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] quota_groups = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] quota_snapshots = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] quota_volumes = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] rate_limit_burst = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] rate_limit_except_level = CRITICAL {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] rate_limit_interval = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] reinit_driver_count = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] replication_device = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] report_discard_supported = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] report_interval = 120 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] reservation_clean_interval = 86400 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] reservation_expire = 86400 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] reserved_image_namespaces = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] reserved_percentage = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] rpc_response_timeout = 120 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] run_external_periodic_tasks = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] scst_target_driver = iscsi {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] scst_target_iqn_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_down_time = 720 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] shell_completion = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] snapshot_name_template = snapshot-%s {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] snapshot_same_host = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] split_loggers = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] state_path = /opt/stack/data/cinder {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] storage_availability_zone = nova {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] storage_protocol = iSCSI {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] syslog_log_facility = LOG_USER {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] target_helper = lioadm {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] target_ip_address = 192.168.122.157 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] target_port = 3260 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] target_protocol = iscsi {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] target_secondary_ip_addresses = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] trace_flags = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] transport_url = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] until_refresh = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] use_chap_auth = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] use_default_quota_class = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] use_journal = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] use_json = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] use_multipath_for_image_xfer = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] use_stderr = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] use_syslog = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] verify_glance_signatures = enabled {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_api_class = cinder.volume.api.API {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_backend_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_clear = zero {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_clear_ionice = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_clear_size = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_copy_bps_limit = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_dd_blocksize = 1M {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_name_template = volume-%s {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_service_inithost_offload = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volume_usage_audit_period = month {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] zoning_mode = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_concurrency.disable_process_locking = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.auth_section = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.auth_type = password {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.auth_version = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.cache = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.certfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.include_service_catalog = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.insecure = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.interface = public {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.keyfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_password = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcache_username = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.region_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.service_type = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.backend = dogpile.cache.null {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.backend_argument = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.backend_expiration_time = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.config_prefix = cache.oslo {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.debug_cache_backend = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.enable_retry_client = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.enable_socket_keepalive = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.expiration_time = 600 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.hashclient_retry_attempts = 2 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.memcache_dead_retry = 300 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack sudo[76262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.memcache_pool_maxsize = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.memcache_sasl_enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack sudo[76262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.password = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.proxies = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.redis_db = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.redis_server = localhost:6379 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.retry_attempts = 2 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.retry_delay = 0.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.socket_keepalive_count = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.socket_keepalive_idle = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.socket_keepalive_interval = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.socket_timeout = 1.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.tls_allowed_ciphers = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.tls_cafile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.tls_certfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.tls_enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.tls_keyfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cache.username = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] coordination.backend_url = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.asyncio_connection = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.asyncio_slave_connection = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.backend = sqlalchemy {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.connection = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.connection_debug = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.connection_parameters = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.connection_recycle_time = 3600 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.connection_trace = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.db_inc_retry_interval = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.db_max_retries = 20 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.db_max_retry_interval = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.db_retry_interval = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.max_overflow = 50 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.max_pool_size = 5 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.max_retries = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.mysql_wsrep_sync_wait = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.pool_timeout = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.retry_interval = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.slave_connection = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.sqlite_synchronous = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.synchronous_reader = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] database.use_db_reconnect = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_tracing.insecure = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.connection_string = messaging:// {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.es_doc_type = notification {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.es_scroll_size = 10000 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.es_scroll_time = 2m {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.filter_error_trace = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.hmac_keys = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.sentinel_service_name = mymaster {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.socket_timeout = 0.1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.trace_requests = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler.trace_sqlalchemy = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler_jaeger.process_tags = {} {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler_jaeger.service_name_prefix = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] profiler_otlp.service_name_prefix = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.enforce_new_defaults = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.policy_default_rule = default {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.policy_file = policy.yaml {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] privsep_osbrick.group = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] privsep_osbrick.helper_command = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] privsep_osbrick.user = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_sys_admin.group = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_sys_admin.helper_command = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] cinder_sys_admin.user = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.auth_section = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.auth_type = password {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.cafile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.certfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.collect_timing = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.insecure = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.keyfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.send_service_user_token = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.split_loggers = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.timeout = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.tls_ciphers = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] service_user.tls_min_version = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.auth_section = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.auth_type = password {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.certfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.collect_timing = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.insecure = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.keyfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.region_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.split_loggers = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.timeout = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.tls_ciphers = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] glance.tls_min_version = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.backend_availability_zone = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.chap_password = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.chap_username = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.disk_geometry = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.driver_client_cert = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.driver_client_cert_key = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.driver_data_namespace = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.driver_use_ssl = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.extra_capabilities = {} {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.filter_function = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.goodness_function = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.iscsi_target_flags = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.iscsi_write_cache = on {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.iser_helper = tgtadm {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.iser_port = 3260 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:09 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.lvm_share_target = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.lvm_type = auto {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.num_shell_tries = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.replication_device = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.report_discard_supported = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.reserved_percentage = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.target_helper = tgtadm {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.target_port = 3260 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.target_protocol = iscsi {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.trace_flags = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.unique_fqdn_network = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.use_chap_auth = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_backend_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_clear = zero {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_clear_ionice = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_clear_size = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_reports.file_event_handler = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_reports.log_dir = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.backend_host = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.chap_password = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.chap_username = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.disk_geometry = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.driver_client_cert = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.extra_capabilities = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.filter_function = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.goodness_function = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.iser_helper = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.iser_ip_address = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.iser_port = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.lvm_share_target = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.lvm_type = auto {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.num_shell_tries = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.replication_device = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.report_discard_supported = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.reserved_percentage = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.scst_target_driver = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.storage_protocol = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.target_helper = lioadm {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.target_ip_address = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.target_port = 3260 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.trace_flags = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.use_chap_auth = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_clear = zero {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_clear_size = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] lvmdriver-1.volumes_dir = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.ssl = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_notifications.driver = [] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_notifications.retry = -1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] key_manager.fixed_key = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.barbican_api_version = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.barbican_endpoint = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.barbican_endpoint_type = public {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.barbican_region_name = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.cafile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.certfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.collect_timing = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.insecure = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.keyfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.number_of_retries = 60 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.retry_delay = 1 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.send_service_user_token = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.split_loggers = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.timeout = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.tls_ciphers = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.tls_min_version = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.verify_ssl = True {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican.verify_ssl_path = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.auth_section = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.auth_type = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.cafile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.certfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.collect_timing = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.insecure = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.keyfile = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.split_loggers = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.timeout = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.tls_ciphers = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] barbican_service_user.tls_min_version = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.approle_role_id = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.approle_secret_id = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.auth_method = approle {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.auth_path = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.kv_mountpoint = secret {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.kv_path = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.kv_version = 2 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.namespace = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.root_token_id = **** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.ssl_ca_crt_file = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.timeout = 60.0 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.token_file = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.token_role = None {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.use_ssl = False {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:04:10 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] ******************************************************************************** {{(pid=76023) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 12:04:10 devstack sudo[76262]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:10 devstack sudo[76384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:10 devstack sudo[76384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:10 devstack sudo[76384]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.251s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:04:10 devstack cinder-volume[76187]: INFO cinder.brick.local_dev.lvm [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:10 devstack sudo[76492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:04:10 devstack sudo[76492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:10 devstack sudo[76492]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG cinder.brick.local_dev.lvm [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76187) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 12:04:10 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:10 devstack sudo[76590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:10 devstack sudo[76590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:12 devstack sudo[76590]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:12 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.527s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:12 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:12 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:12 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:12 devstack sudo[76888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:12 devstack sudo[76888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:12 devstack sudo[76888]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:12 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.397s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:12 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:12 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:12 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:12 devstack sudo[76965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 12:04:12 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:13 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:13 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.301s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:13 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:13 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:04:13 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:13 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:13 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:13 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:13 devstack sudo[76971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:04:13 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:13 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:13 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:13 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:13 devstack sudo[76980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:04:13 devstack sudo[76980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:13 devstack sudo[76980]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:13 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:13 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:13 devstack sudo[76983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:13 devstack sudo[76983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:14 devstack sudo[76983]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:14 devstack sudo[76987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:14 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:14 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:14 devstack cinder-volume[76187]: INFO cinder.volume.drivers.lvm [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:14 devstack sudo[76991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:14 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:14 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:04:14 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:14 devstack sudo[76996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:04:14 devstack sudo[76996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:15 devstack sudo[76996]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:15 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:15 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:15 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:04:15 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:15 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:15 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:15 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:15 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:15 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:15 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:15 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:15 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:15 devstack sudo[77006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:04:15 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:15 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:15 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:15 devstack cinder-volume[76187]: INFO cinder.volume.driver [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 12:04:15 devstack cinder-volume[76187]: DEBUG cinder.volume.driver [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76187) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG oslo_db.sqlalchemy.engines [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76187) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writer thread running {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG cinder.db.api [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Building query based on filter {{(pid=76187) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG cinder.image.image_utils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76187) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 12:04:16 devstack cinder-volume[76187]: INFO cinder.keymgr.migration [None req-5a1ebe8b-f83c-40fa-8e67-dcd7c18ea312 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:16 devstack sudo[77009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:04:16 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:16 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:16 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:04:16 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:16 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:16 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:16 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:16 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:16 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:16 devstack sudo[77023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:04:16 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:17 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:04:17 devstack cinder-volume[76187]: INFO cinder.volume.manager [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Driver initialization completed successfully. Sep 28 12:04:17 devstack cinder-volume[76187]: INFO cinder.manager [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Initiating service 2 cleanup Sep 28 12:04:17 devstack cinder-volume[76187]: INFO cinder.manager [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Service 2 cleanup completed. Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG cinder.service [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Creating RPC server for service cinder-volume {{(pid=76187) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG cinder.service [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76187) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 12:04:17 devstack cinder-volume[76187]: INFO cinder.volume.manager [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:17 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:04:17 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:17 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:17 devstack sudo[77030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:04:17 devstack sudo[77030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:17 devstack sudo[77030]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:17 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:17 devstack sudo[77037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:04:17 devstack sudo[77037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:18 devstack sudo[77037]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:18 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:18 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:04:18 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:04:18 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:04:18 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:04:18 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Sep 28 12:04:18 devstack cinder-volume[76187]: INFO cinder.volume.manager [None req-ce6e7767-3aed-42e9-ab47-48a4e9df3869 None None] Driver post RPC initialization completed successfully. Sep 28 12:04:19 devstack cinder-volume[76023]: DEBUG dbcounter [-] [76023] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76023) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:04:28 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:04:28 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:05:08 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:05:08 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:05:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:08 devstack sudo[78973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:05:08 devstack sudo[78973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:08 devstack sudo[78973]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:08 devstack sudo[78976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:05:08 devstack sudo[78976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:09 devstack sudo[78976]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:09 devstack sudo[78979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:05:09 devstack sudo[78979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:09 devstack sudo[78979]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:05:09 devstack sudo[78982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:05:09 devstack sudo[78982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:05:09 devstack sudo[78982]: pam_unix(sudo:session): session closed for user root Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running periodic task VolumeManager._thread_info {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG cinder.volume.manager [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] thread count: 6 {{(pid=76187) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:05:09 devstack cinder-volume[76187]: DEBUG cinder.volume.manager [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] thread info: [<_MainThread(MainThread, started 138713565732992)>, , , , , ] {{(pid=76187) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:06:08 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:06:08 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:06:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:08 devstack sudo[82280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:06:08 devstack sudo[82280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:08 devstack sudo[82280]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:08 devstack sudo[82283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:08 devstack sudo[82283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:09 devstack sudo[82283]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack sudo[82286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:09 devstack sudo[82286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:09 devstack sudo[82286]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack sudo[82289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:09 devstack sudo[82289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:09 devstack sudo[82289]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:28 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:07:08 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:07:08 devstack cinder-volume[76187]: DEBUG cinder.volume.drivers.lvm [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Updating volume stats {{(pid=76187) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:07:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:08 devstack sudo[84068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:07:08 devstack sudo[84068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:08 devstack sudo[84068]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:08 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:08 devstack sudo[84080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:07:08 devstack sudo[84080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:09 devstack sudo[84080]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:09 devstack sudo[84083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:07:09 devstack sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:09 devstack sudo[84083]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:09 devstack sudo[84106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:07:09 devstack sudo[84106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:09 devstack sudo[84106]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG oslo_concurrency.processutils [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76187) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG cinder.manager [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Notifying Schedulers of capabilities ... {{(pid=76187) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG oslo_service.periodic_task [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] Running periodic task VolumeManager._thread_info {{(pid=76187) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG cinder.volume.manager [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] thread count: 6 {{(pid=76187) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:07:09 devstack cinder-volume[76187]: DEBUG cinder.volume.manager [None req-c6f098b6-8261-4df8-a96d-d20f11f643d0 None None] thread info: [<_MainThread(MainThread, started 138713565732992)>, , , , , ] {{(pid=76187) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:08:28 devstack cinder-volume[76187]: DEBUG dbcounter [-] [76187] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76187) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:08:44 devstack cinder-volume[76023]: INFO oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Caught SIGTERM, stopping children Sep 28 12:08:44 devstack cinder-volume[76023]: DEBUG oslo_concurrency.lockutils [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Acquiring lock "singleton_lock" {{(pid=76023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:08:44 devstack cinder-volume[76023]: DEBUG oslo_concurrency.lockutils [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Acquired lock "singleton_lock" {{(pid=76023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:08:44 devstack cinder-volume[76023]: DEBUG oslo_concurrency.lockutils [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Releasing lock "singleton_lock" {{(pid=76023) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:08:44 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Stop services. {{(pid=76023) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 12:08:44 devstack cinder-volume[76023]: DEBUG oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Killing children. {{(pid=76023) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 12:08:44 devstack cinder-volume[76023]: INFO oslo_service.backend._eventlet.service [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Waiting on 1 children to exit Sep 28 12:08:49 devstack cinder-volume[76187]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 12:08:50 devstack cinder-volume[86206]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 12:08:50 devstack cinder-volume[86206]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 12:08:50 devstack cinder-volume[86206]: we strongly recommend against using it for new projects. Sep 28 12:08:50 devstack cinder-volume[86206]: If you are already using Eventlet, we recommend migrating to a different Sep 28 12:08:50 devstack cinder-volume[86206]: framework. For more detail see Sep 28 12:08:50 devstack cinder-volume[86206]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 12:08:50 devstack cinder-volume[86206]: import eventlet # noqa Sep 28 12:08:52 devstack cinder-volume[76187]: DEBUG oslo_concurrency.lockutils [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Acquiring lock "singleton_lock" {{(pid=76187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:08:52 devstack cinder-volume[76187]: DEBUG oslo_concurrency.lockutils [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Acquired lock "singleton_lock" {{(pid=76187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:08:52 devstack cinder-volume[76187]: DEBUG oslo_concurrency.lockutils [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Releasing lock "singleton_lock" {{(pid=76187) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:08:52 devstack cinder-volume[76187]: WARNING amqp [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 12:08:52 devstack cinder-volume[76187]: WARNING amqp [None req-302a8e76-14ef-4c69-98aa-296d7dcbee45 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 12:08:52 devstack cinder-volume[86206]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:08:52 devstack cinder-volume[86206]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:08:52 devstack cinder-volume[86206]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:08:53 devstack cinder-volume[86206]: INFO dbcounter [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Registered counter for database cinder Sep 28 12:08:53 devstack cinder-volume[86206]: DEBUG oslo_db.sqlalchemy.engines [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:08:53 devstack cinder-volume[86206]: DEBUG dbcounter [-] [86206] Writer thread running {{(pid=86206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:08:53 devstack cinder-volume[86206]: INFO cinder.rpc [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 12:08:53 devstack cinder-volume[86206]: INFO cinder.rpc [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 12:08:53 devstack cinder-volume[86206]: DEBUG oslo_db.sqlalchemy.engines [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:08:53 devstack cinder-volume[86206]: INFO cinder.volume.manager [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Determined volume DB was empty at startup. Sep 28 12:08:53 devstack cinder-volume[86206]: DEBUG cinder.volume.manager [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86206) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 12:08:53 devstack cinder-volume[86206]: INFO cinder.volume.manager [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 12:08:53 devstack cinder-volume[86206]: WARNING stevedore.named [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 12:08:53 devstack cinder-volume[86206]: WARNING castellan.key_manager [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:08:53 devstack cinder-volume[86206]: WARNING cinder.keymgr.conf_key_mgr [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:08:53 devstack cinder-volume[86206]: INFO cinder.volume.manager [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_db.sqlalchemy.engines [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:08:54 devstack cinder-volume[86206]: INFO oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Starting 1 workers Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Started child 86426 {{(pid=86206) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Full set of CONF: {{(pid=86206) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] ******************************************************************************** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Configuration options gathered from: {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] ================================================================================ {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] allow_availability_zone_fallback = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] allow_compression_on_image_upload = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] allowed_direct_url_schemes = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] api_rate_limit = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] auth_strategy = keystone {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_availability_zone = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_host = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86426]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_stats_polling_interval = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backup_api_class = cinder.backup.api.API {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backup_name_template = backup-%s {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backup_use_same_host = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backup_use_temp_snapshot = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] chap_password = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] chap_username = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_internal_tenant_project_id = debad409a10141b8a86aaffcfeab3a67 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_internal_tenant_user_id = 06b7d8d002d8410d902133dba51861c1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cluster = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] compression_format = gzip {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] config_dir = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] config_source = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] control_exchange = openstack {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] debug = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] default_availability_zone = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] default_group_type = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] default_volume_type = QuobyteHD {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] disk_geometry = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] driver_client_cert = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] driver_client_cert_key = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] driver_data_namespace = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] driver_ssl_cert_path = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] driver_ssl_cert_verify = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] driver_use_ssl = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] enable_new_services = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] enable_unsupported_driver = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] enforce_multipath_for_image_xfer = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] filter_function = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_api_insecure = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_api_servers = ['http://192.168.122.157/image'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_api_ssl_compression = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_ca_certificates_file = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_certfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_keyfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_num_retries = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance_request_timeout = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] goodness_function = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] graceful_shutdown_timeout = 5 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] group_api_class = cinder.group.api.API {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] host = devstack {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_compress_on_upload = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_conversion_address_space_limit = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_conversion_cpu_limit = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_conversion_disable = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_introspection_address_space_limit = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_introspection_cpu_limit = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_upload_use_cinder_backend = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_upload_use_internal_tenant = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_volume_cache_enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_volume_cache_max_count = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] init_host_max_objects_retrieval = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] instance_format = [instance: %(uuid)s] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] iscsi_target_flags = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] iscsi_write_cache = on {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] iser_helper = tgtadm {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] iser_ip_address = 192.168.122.157 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] iser_port = 3260 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_color = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_config_append = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_dir = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86426]: INFO cinder.volume.manager [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.remotefs [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86426) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_file = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_options = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_rotate_interval = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_rotate_interval_type = days {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] log_rotation_type = none {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] max_age = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] max_logfile_count = 30 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] max_logfile_size_mb = 200 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] max_over_subscription_ratio = 20.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] message_reap_interval = 86400 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] message_ttl = 2592000 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] monkey_patch = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] monkey_patch_modules = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] my_ip = 192.168.122.157 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] no_snapshot_gb_quota = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] num_iser_scan_tries = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] num_shell_tries = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] num_volume_device_scan_tries = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] nvmeof_conn_info_version = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] nvmet_ns_id = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] nvmet_port_id = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] osapi_max_limit = 1000 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] osapi_volume_ext_list = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] osapi_volume_listen_port = 8776 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] osapi_volume_use_ssl = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] osapi_volume_workers = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] per_volume_size_limit = -1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] periodic_fuzzy_delay = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] periodic_interval = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] public_endpoint = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] publish_errors = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] quota_backup_gigabytes = 1000 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] quota_backups = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] quota_gigabytes = 1000 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] quota_groups = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] quota_snapshots = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] quota_volumes = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] rate_limit_burst = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] rate_limit_except_level = CRITICAL {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] rate_limit_interval = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] reinit_driver_count = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] replication_device = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] report_discard_supported = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] report_interval = 120 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] reservation_clean_interval = 86400 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] reservation_expire = 86400 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] reserved_image_namespaces = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] reserved_percentage = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] rpc_response_timeout = 120 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] run_external_periodic_tasks = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] scst_target_driver = iscsi {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] scst_target_iqn_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_down_time = 720 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] shell_completion = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] snapshot_name_template = snapshot-%s {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] split_loggers = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] state_path = /opt/stack/data/cinder {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] storage_availability_zone = nova {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] storage_protocol = iSCSI {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] syslog_log_facility = LOG_USER {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] target_helper = lioadm {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] target_ip_address = 192.168.122.157 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] target_port = 3260 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] target_protocol = iscsi {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] target_secondary_ip_addresses = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] trace_flags = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] transport_url = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] until_refresh = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] use_chap_auth = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] use_default_quota_class = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] use_journal = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] use_json = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] use_multipath_for_image_xfer = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] use_stderr = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] use_syslog = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] verify_glance_signatures = enabled {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_api_class = cinder.volume.api.API {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_backend_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_clear = zero {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_clear_ionice = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_clear_size = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_copy_bps_limit = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_dd_blocksize = 1M {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_name_template = volume-%s {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_service_inithost_offload = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volume_usage_audit_period = month {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] zoning_mode = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.auth_section = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.auth_type = password {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.auth_version = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.cache = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.certfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.insecure = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.interface = public {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.keyfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_password = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86426) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 12:08:54 devstack cinder-volume[86426]: WARNING cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 12:08:54 devstack cinder-volume[86426]: WARNING cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Running cmd (subprocess): mount.quobyte {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcache_username = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.region_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.service_type = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.backend = dogpile.cache.null {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.backend_argument = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.backend_expiration_time = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.config_prefix = cache.oslo {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.debug_cache_backend = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.enable_retry_client = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.enable_socket_keepalive = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.expiration_time = 600 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.memcache_dead_retry = 300 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.memcache_sasl_enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.password = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.proxies = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.redis_db = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.redis_server = localhost:6379 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.retry_attempts = 2 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.retry_delay = 0.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.socket_keepalive_count = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.socket_keepalive_idle = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.socket_keepalive_interval = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.socket_timeout = 1.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.tls_allowed_ciphers = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.tls_cafile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.tls_certfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.tls_enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.tls_keyfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cache.username = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] coordination.backend_url = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.asyncio_connection = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.asyncio_slave_connection = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.backend = sqlalchemy {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.connection = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.connection_debug = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.connection_parameters = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.connection_recycle_time = 3600 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.connection_trace = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.db_inc_retry_interval = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.db_max_retries = 20 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.db_max_retry_interval = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.db_retry_interval = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.max_overflow = 50 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.max_pool_size = 5 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.max_retries = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.pool_timeout = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.retry_interval = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.slave_connection = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.sqlite_synchronous = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.synchronous_reader = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] database.use_db_reconnect = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_tracing.insecure = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.connection_string = messaging:// {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.es_doc_type = notification {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.es_scroll_size = 10000 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.es_scroll_time = 2m {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.filter_error_trace = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.hmac_keys = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.sentinel_service_name = mymaster {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.socket_timeout = 0.1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.trace_requests = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler.trace_sqlalchemy = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler_jaeger.process_tags = {} {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] profiler_otlp.service_name_prefix = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.policy_default_rule = default {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] privsep_osbrick.group = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] privsep_osbrick.helper_command = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] privsep_osbrick.user = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_sys_admin.group = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_sys_admin.helper_command = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] cinder_sys_admin.user = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.auth_section = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.auth_type = password {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.cafile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.certfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.collect_timing = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.insecure = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.keyfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.send_service_user_token = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.split_loggers = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.timeout = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.tls_ciphers = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] service_user.tls_min_version = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.auth_section = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.auth_type = password {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.certfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.collect_timing = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.insecure = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.keyfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.region_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.split_loggers = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.timeout = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.tls_ciphers = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] glance.tls_min_version = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.backend_availability_zone = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.chap_password = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.chap_username = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.disk_geometry = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.driver_client_cert = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.driver_data_namespace = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.driver_use_ssl = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.extra_capabilities = {} {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.filter_function = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.goodness_function = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.iscsi_target_flags = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.iser_port = 3260 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_host = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_login = admin {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_mount_options = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_password = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_private_key = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_share_path = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.replication_device = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.report_discard_supported = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.target_helper = tgtadm {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.target_port = 3260 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.target_protocol = iscsi {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.trace_flags = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.use_chap_auth = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volume_backend_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volume_clear = zero {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_reports.file_event_handler = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_reports.log_dir = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.backend_host = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.chap_password = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.chap_username = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.disk_geometry = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.driver_client_cert = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.extra_capabilities = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.filter_function = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.goodness_function = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.iser_helper = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.iser_ip_address = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.iser_port = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_host = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_login = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_mount_options = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_password = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_private_key = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_share_path = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.num_shell_tries = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.replication_device = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.report_discard_supported = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.reserved_percentage = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.scst_target_driver = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.storage_protocol = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.target_helper = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.target_ip_address = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.target_port = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.target_prefix = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.target_protocol = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.trace_flags = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.use_chap_auth = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volume_clear = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volume_clear_size = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] QuobyteHD.volumes_dir = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack quobyte-client[86430]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack quobyte-client[86430]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_notifications.driver = [] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] key_manager.fixed_key = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.barbican_api_version = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.barbican_endpoint = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.barbican_endpoint_type = public {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.barbican_region_name = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.cafile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.certfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.collect_timing = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.insecure = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.keyfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.number_of_retries = 60 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.retry_delay = 1 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.send_service_user_token = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.split_loggers = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.timeout = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.tls_ciphers = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.tls_min_version = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.verify_ssl = True {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican.verify_ssl_path = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.auth_section = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.auth_type = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.cafile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.certfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] CMD "mount.quobyte" returned: 1 in 0.142s {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.collect_timing = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.insecure = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.keyfile = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.split_loggers = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.timeout = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.tls_ciphers = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] barbican_service_user.tls_min_version = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.approle_role_id = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.approle_secret_id = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=86426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.auth_method = approle {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.auth_path = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.kv_mountpoint = secret {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.kv_path = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86426]: INFO cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe ... Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.kv_version = 2 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.namespace = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 -c /etc/quobyte/client-cinder.cfg {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.root_token_id = **** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.ssl_ca_crt_file = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.timeout = 60.0 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.token_file = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.token_role = None {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.use_ssl = False {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:08:54 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] ******************************************************************************** {{(pid=86206) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 12:08:54 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 -c /etc/quobyte/client-cinder.cfg Sep 28 12:08:54 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:54 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.405s {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:54 devstack cinder-volume[86426]: INFO cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe succeeded Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=86426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.426s {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:54 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:54 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:08:54 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:55 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.249s {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:55 devstack cinder-volume[86426]: INFO cinder.volume.driver [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.volume.driver [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2007369995117, 'free_capacity_gb': 1775.2007369995117, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86426) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_db.sqlalchemy.engines [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86426) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG dbcounter [-] [86426] Writer thread running {{(pid=86426) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.db.api [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Building query based on filter {{(pid=86426) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.image.image_utils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86426) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 12:08:55 devstack cinder-volume[86426]: INFO cinder.keymgr.migration [None req-83977454-4168-4d8d-bff7-93d9fbc81d9c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=86426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=86426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:55 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:08:55 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:55 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.234s {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.manager [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Notifying Schedulers of capabilities ... {{(pid=86426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:55 devstack cinder-volume[86426]: INFO cinder.volume.manager [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Driver initialization completed successfully. Sep 28 12:08:55 devstack cinder-volume[86426]: INFO cinder.manager [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Initiating service 3 cleanup Sep 28 12:08:55 devstack cinder-volume[86426]: INFO cinder.manager [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Service 3 cleanup completed. Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.service [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Creating RPC server for service cinder-volume {{(pid=86426) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.service [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86426) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 12:08:55 devstack cinder-volume[86426]: INFO cinder.volume.manager [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=86426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=86426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:55 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:08:55 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:55 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:55 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.300s {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:55 devstack cinder-volume[86426]: INFO cinder.volume.manager [None req-ef14ffab-86ff-461e-a805-9f543b12e352 None None] Driver post RPC initialization completed successfully. Sep 28 12:09:01 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:09:01 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:09:01 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=86426) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:09:01 devstack cinder-volume[86426]: DEBUG cinder.volume.drivers.quobyte [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=86426) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:09:01 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86426) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:09:01 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:01 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:09:01 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:09:01 devstack cinder-volume[86206]: INFO oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Caught SIGTERM, stopping children Sep 28 12:09:01 devstack cinder-volume[86206]: DEBUG oslo_concurrency.lockutils [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Acquiring lock "singleton_lock" {{(pid=86206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:09:01 devstack cinder-volume[86206]: DEBUG oslo_concurrency.lockutils [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Acquired lock "singleton_lock" {{(pid=86206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:09:01 devstack cinder-volume[86206]: DEBUG oslo_concurrency.lockutils [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Releasing lock "singleton_lock" {{(pid=86206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:09:01 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Stop services. {{(pid=86206) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 12:09:01 devstack cinder-volume[86206]: DEBUG oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Killing children. {{(pid=86206) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 12:09:01 devstack cinder-volume[86206]: INFO oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Waiting on 1 children to exit Sep 28 12:09:01 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Sep 28 12:09:01 devstack cinder-volume[86426]: DEBUG oslo_concurrency.processutils [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.303s {{(pid=86426) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:01 devstack cinder-volume[86426]: DEBUG cinder.manager [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Notifying Schedulers of capabilities ... {{(pid=86426) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Unable to connect to AMQP server on 192.168.122.157:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server [None req-ce0ca9cc-6ba4-4c5f-afe0-cd218fe555ab None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.157:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server method() Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return _publish( Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server listener(*args) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.157:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 28 12:09:01 devstack cinder-volume[86426]: ERROR oslo_messaging.rpc.server Sep 28 12:09:03 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Acquiring lock "singleton_lock" {{(pid=86426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:09:03 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Acquired lock "singleton_lock" {{(pid=86426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:09:03 devstack cinder-volume[86426]: DEBUG oslo_concurrency.lockutils [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Releasing lock "singleton_lock" {{(pid=86426) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:09:03 devstack cinder-volume[86426]: WARNING amqp [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 12:09:03 devstack cinder-volume[86426]: WARNING amqp [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 12:09:03 devstack cinder-volume[86206]: INFO oslo_service.backend._eventlet.service [None req-63a0dc34-3c76-4e84-a5fd-1325203e89a1 None None] Child 86426 exited with status 0 Sep 28 12:09:04 devstack cinder-volume[86843]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 12:09:04 devstack cinder-volume[86843]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 12:09:04 devstack cinder-volume[86843]: we strongly recommend against using it for new projects. Sep 28 12:09:04 devstack cinder-volume[86843]: If you are already using Eventlet, we recommend migrating to a different Sep 28 12:09:04 devstack cinder-volume[86843]: framework. For more detail see Sep 28 12:09:04 devstack cinder-volume[86843]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 12:09:04 devstack cinder-volume[86843]: import eventlet # noqa Sep 28 12:09:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:09:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:09:07 devstack cinder-volume[86843]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:09:08 devstack cinder-volume[86843]: INFO dbcounter [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Registered counter for database cinder Sep 28 12:09:08 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writer thread running {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:09:09 devstack cinder-volume[86843]: INFO cinder.rpc [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 12:09:09 devstack cinder-volume[86843]: INFO cinder.rpc [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:09:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Determined volume DB was empty at startup. Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG cinder.volume.manager [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86843) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 12:09:09 devstack cinder-volume[86843]: WARNING stevedore.named [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 12:09:09 devstack cinder-volume[86843]: WARNING castellan.key_manager [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:09:09 devstack cinder-volume[86843]: WARNING cinder.keymgr.conf_key_mgr [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:09:09 devstack cinder-volume[86843]: INFO cinder.volume.manager [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_db.sqlalchemy.engines [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:09:09 devstack cinder-volume[86843]: INFO oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Starting 1 workers Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Started child 87167 {{(pid=86843) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Full set of CONF: {{(pid=86843) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] ******************************************************************************** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] Configuration options gathered from: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] ================================================================================ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] allow_availability_zone_fallback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] allow_compression_on_image_upload = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] allowed_direct_url_schemes = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] api_rate_limit = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] auth_strategy = keystone {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_stats_polling_interval = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backup_api_class = cinder.backup.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backup_name_template = backup-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backup_use_same_host = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backup_use_temp_snapshot = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] chap_username = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_internal_tenant_project_id = debad409a10141b8a86aaffcfeab3a67 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_internal_tenant_user_id = 06b7d8d002d8410d902133dba51861c1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cluster = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] compression_format = gzip {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] compute_api_class = cinder.compute.nova.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] config_dir = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] config_source = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] control_exchange = openstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] debug = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] default_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] default_group_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] default_volume_type = QuobyteHD {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] driver_ssl_cert_verify = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] driver_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] enable_new_services = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] enable_unsupported_driver = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] enabled_backends = ['QuobyteHD'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] enforce_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_api_insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_api_servers = ['http://192.168.122.157/image'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_api_ssl_compression = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_ca_certificates_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_catalog_info = image:glance:publicURL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[87167]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_num_retries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance_request_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] graceful_shutdown_timeout = 5 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] group_api_class = cinder.group.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] host = devstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_compress_on_upload = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_conversion_address_space_limit = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_conversion_cpu_limit = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_conversion_disable = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_introspection_address_space_limit = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_introspection_cpu_limit = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_upload_use_cinder_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_upload_use_internal_tenant = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_volume_cache_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_volume_cache_max_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] image_volume_cache_max_size_gb = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] init_host_max_objects_retrieval = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] instance_format = [instance: %(uuid)s] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] iscsi_target_flags = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] iscsi_write_cache = on {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] iser_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] iser_ip_address = 192.168.122.157 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] iser_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_color = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_config_append = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_options = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_rotate_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_rotate_interval_type = days {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] log_rotation_type = none {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] max_age = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] max_logfile_count = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] max_logfile_size_mb = 200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] max_over_subscription_ratio = 20.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] message_reap_interval = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] message_ttl = 2592000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] migration_create_volume_timeout_secs = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] monkey_patch = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] monkey_patch_modules = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] my_ip = 192.168.122.157 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] no_snapshot_gb_quota = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] num_iser_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] num_shell_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] num_volume_device_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] nvmeof_conn_info_version = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] nvmet_ns_id = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] nvmet_port_id = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] osapi_max_limit = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] osapi_volume_ext_list = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] osapi_volume_listen_port = 8776 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] osapi_volume_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] osapi_volume_workers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] per_volume_size_limit = -1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] periodic_fuzzy_delay = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] periodic_interval = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] public_endpoint = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] publish_errors = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] quota_backup_gigabytes = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] quota_backups = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] quota_gigabytes = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] quota_groups = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] quota_snapshots = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] quota_volumes = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] rate_limit_burst = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] rate_limit_except_level = CRITICAL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] rate_limit_interval = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] reinit_driver_count = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] report_discard_supported = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] report_interval = 120 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] reservation_clean_interval = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] reservation_expire = 86400 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] reserved_image_namespaces = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] reserved_percentage = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] rpc_response_timeout = 120 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] run_external_periodic_tasks = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] scst_target_driver = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_down_time = 720 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] shell_completion = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] snapshot_name_template = snapshot-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] state_path = /opt/stack/data/cinder {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] storage_availability_zone = nova {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] storage_protocol = iSCSI {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] syslog_log_facility = LOG_USER {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] target_helper = lioadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] target_ip_address = 192.168.122.157 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] target_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] target_protocol = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] target_secondary_ip_addresses = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] transport_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] until_refresh = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] use_chap_auth = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] use_default_quota_class = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] use_journal = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] use_json = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] use_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] use_stderr = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] use_syslog = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] verify_glance_signatures = enabled {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_api_class = cinder.volume.api.API {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_clear = zero {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_clear_size = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_copy_bps_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_dd_blocksize = 1M {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_name_template = volume-%s {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_service_inithost_offload = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volume_usage_audit_period = month {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] zoning_mode = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_concurrency.disable_process_locking = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.auth_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.include_service_catalog = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.interface = public {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcache_username = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.service_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.backend = dogpile.cache.null {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.backend_argument = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.backend_expiration_time = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.config_prefix = cache.oslo {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.debug_cache_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.enable_retry_client = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.enable_socket_keepalive = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.expiration_time = 600 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.hashclient_retry_attempts = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.memcache_dead_retry = 300 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.memcache_pool_maxsize = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.memcache_sasl_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.proxies = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.redis_db = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.redis_server = localhost:6379 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87167) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.retry_attempts = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.retry_delay = 0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.socket_keepalive_count = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.socket_keepalive_idle = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.socket_keepalive_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.socket_timeout = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.tls_allowed_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.tls_cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.tls_certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.tls_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.tls_keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cache.username = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] coordination.backend_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.asyncio_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.asyncio_slave_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.backend = sqlalchemy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.connection_debug = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.connection_parameters = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.connection_recycle_time = 3600 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.connection_trace = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.db_inc_retry_interval = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.db_max_retries = 20 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.db_max_retry_interval = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.db_retry_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.max_overflow = 50 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.max_pool_size = 5 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.max_retries = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.mysql_wsrep_sync_wait = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.pool_timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.retry_interval = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.slave_connection = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.sqlite_synchronous = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.synchronous_reader = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] database.use_db_reconnect = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_tracing.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.connection_string = messaging:// {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.es_doc_type = notification {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.es_scroll_size = 10000 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.es_scroll_time = 2m {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.filter_error_trace = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.hmac_keys = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.sentinel_service_name = mymaster {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.socket_timeout = 0.1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.trace_requests = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler.trace_sqlalchemy = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler_jaeger.process_tags = {} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler_jaeger.service_name_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] profiler_otlp.service_name_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.enforce_new_defaults = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.policy_default_rule = default {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.policy_file = policy.yaml {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] privsep_osbrick.group = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] privsep_osbrick.helper_command = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] privsep_osbrick.user = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_sys_admin.group = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_sys_admin.helper_command = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] cinder_sys_admin.user = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.send_service_user_token = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.tls_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] service_user.tls_min_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.auth_type = password {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.tls_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] glance.tls_min_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.chap_username = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.driver_use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.extra_capabilities = {} {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.iscsi_target_flags = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.iscsi_write_cache = on {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.iser_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.iser_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_host = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_login = admin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_mount_options = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_private_key = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_share_path = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.num_shell_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.quobyte_volume_url = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.report_discard_supported = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.reserved_percentage = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.target_helper = tgtadm {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.target_port = 3260 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.target_protocol = iscsi {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.unique_fqdn_network = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.use_chap_auth = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volume_backend_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volume_clear = zero {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volume_clear_size = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_reports.file_event_handler = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_reports.log_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.backend_availability_zone = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.backend_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.chap_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.chap_username = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.chiscsi_conf = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.disk_geometry = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.driver_client_cert = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.driver_data_namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.driver_use_ssl = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.extra_capabilities = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.filter_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.goodness_function = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.iser_helper = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.iser_ip_address = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.iser_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.iser_target_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_host = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_login = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_mount_options = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:09 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_password = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87167) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_private_key = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_share_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_ssh_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.num_shell_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.nvmet_port_id = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.replication_device = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.report_discard_supported = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.reserved_percentage = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.scst_target_driver = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Running cmd (subprocess): mount.quobyte {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.storage_protocol = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.target_helper = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.target_ip_address = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.target_port = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.target_prefix = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.target_protocol = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.trace_flags = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.use_chap_auth = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volume_clear = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volume_clear_size = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] QuobyteHD.volumes_dir = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_notifications.driver = [] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_notifications.retry = -1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] key_manager.fixed_key = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.barbican_api_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.barbican_endpoint = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.barbican_endpoint_type = public {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.barbican_region_name = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.number_of_retries = 60 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.retry_delay = 1 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.send_service_user_token = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.tls_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.tls_min_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.verify_ssl = True {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican.verify_ssl_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.auth_section = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.auth_type = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.cafile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.certfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.collect_timing = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.insecure = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.keyfile = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.split_loggers = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.timeout = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.tls_ciphers = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] barbican_service_user.tls_min_version = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.approle_role_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.approle_secret_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.auth_method = approle {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.auth_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.kv_mountpoint = secret {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.kv_path = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.kv_version = 2 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.namespace = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.root_token_id = **** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.ssl_ca_crt_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.timeout = 60.0 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.token_file = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.token_role = None {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.use_ssl = False {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:09:10 devstack cinder-volume[86843]: DEBUG oslo_service.backend._eventlet.service [None req-bee798ac-9928-46ff-9a7e-0ed308ee086d None None] ******************************************************************************** {{(pid=86843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:10 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.343s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:10 devstack cinder-volume[87167]: INFO cinder.volume.driver [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.volume.driver [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.200527191162, 'free_capacity_gb': 1775.200527191162, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87167) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_db.sqlalchemy.engines [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writer thread running {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.db.api [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Building query based on filter {{(pid=87167) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87167) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:10 devstack cinder-volume[87167]: INFO cinder.keymgr.migration [None req-e0a6bbd1-ed81-487d-8f05-3f20501b7b90 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 12:09:10 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:09:10 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:09:10 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.420s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:10 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:09:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Driver initialization completed successfully. Sep 28 12:09:11 devstack cinder-volume[87167]: INFO cinder.manager [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Initiating service 3 cleanup Sep 28 12:09:11 devstack cinder-volume[87167]: INFO cinder.manager [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Service 3 cleanup completed. Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG cinder.service [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Creating RPC server for service cinder-volume {{(pid=87167) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG cinder.service [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87167) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 12:09:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:11 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:09:11 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:09:11 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Sep 28 12:09:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.269s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-58c3c83d-110e-41e2-a485-17185bb18e69 None None] Driver post RPC initialization completed successfully. Sep 28 12:09:19 devstack cinder-volume[86843]: DEBUG dbcounter [-] [86843] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:09:21 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:09:21 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:09:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:09:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 6 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:09:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Flow 'volume_create_manager' (9a931e50-f993-4cf0-8acd-5d710b6e3928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87febd94-15c3-444d-8bd8-31ce6ffce942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87febd94-15c3-444d-8bd8-31ce6ffce942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2073235001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa604b441ade481eaa2b56bf0d41d6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:09Z,use_quota=True,user_id='f3cac4372510477f9933489d5fe11532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb50b5a4-a269-46e7-b5a9-c8bfabf506c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb50b5a4-a269-46e7-b5a9-c8bfabf506c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfe66c8-79d0-4dcd-82b6-43a99ed065fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfe66c8-79d0-4dcd-82b6-43a99ed065fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4', 'volume_name': 'volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295e2065-f931-4031-9852-d6bc4487af35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295e2065-f931-4031-9852-d6bc4487af35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff563828-d0af-4de8-96da-422c62566594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Volume 4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4', 'volume_size': 1} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2073235001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa604b441ade481eaa2b56bf0d41d6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:09Z,use_quota=True,user_id='f3cac4372510477f9933489d5fe11532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Creating volume 4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:10:09 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:10:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:09 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 1073741824 Sep 28 12:10:09 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:10 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 1073741824" returned: 0 in 0.878s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:10 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 Sep 28 12:10:10 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:11 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4" returned: 0 in 0.453s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff563828-d0af-4de8-96da-422c62566594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5996403d-0bf3-4636-9159-5bede3aa6246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Volume volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 (4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4): created successfully Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5996403d-0bf3-4636-9159-5bede3aa6246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Flow 'volume_create_manager' (9a931e50-f993-4cf0-8acd-5d710b6e3928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ec6c7c0b-ae4c-45fc-a391-f1177f994a44 tempest-TaggedAttachmentsTest-1499180902 None] Created volume successfully. Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Flow 'volume_create_manager' (d975e4b7-addb-4b05-ada6-069f5882f170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165603bd-de5f-4d7d-85d4-3938cd102b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165603bd-de5f-4d7d-85d4-3938cd102b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1940643697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc05042-ecca-4a9b-8994-f511430c7b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7e07fb3df45ba9257e114507c2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:11Z,use_quota=True,user_id='90eac5ccda654a838e5a4aa62eaa8e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(388914a3-0a53-471f-87af-3ea1bd2f3e6d),volume_type_id=388914a3-0a53-471f-87af-3ea1bd2f3e6d)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d58dde-1b23-4192-8d6f-58423ebd090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d58dde-1b23-4192-8d6f-58423ebd090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c716e26-9d8d-47ed-ae48-59241260e7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c716e26-9d8d-47ed-ae48-59241260e7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc05042-ecca-4a9b-8994-f511430c7b90', 'volume_name': 'volume-2bc05042-ecca-4a9b-8994-f511430c7b90', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79073bdd-522b-43ec-accd-ea6702951fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79073bdd-522b-43ec-accd-ea6702951fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcda3722-3161-43d9-a791-c849ad1e232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Volume 2bc05042-ecca-4a9b-8994-f511430c7b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc05042-ecca-4a9b-8994-f511430c7b90', 'volume_size': 1} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1940643697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc05042-ecca-4a9b-8994-f511430c7b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cc7e07fb3df45ba9257e114507c2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:11Z,use_quota=True,user_id='90eac5ccda654a838e5a4aa62eaa8e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(388914a3-0a53-471f-87af-3ea1bd2f3e6d),volume_type_id=388914a3-0a53-471f-87af-3ea1bd2f3e6d)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Creating volume 2bc05042-ecca-4a9b-8994-f511430c7b90 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:10:11 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:10:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:11 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 1073741824 Sep 28 12:10:11 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:12 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 1073741824" returned: 0 in 0.797s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:12 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 Sep 28 12:10:12 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:12 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90" returned: 0 in 0.351s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcda3722-3161-43d9-a791-c849ad1e232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc05042-ecca-4a9b-8994-f511430c7b90', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d11813d-97e5-4153-904f-faa378ffab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Volume volume-2bc05042-ecca-4a9b-8994-f511430c7b90 (2bc05042-ecca-4a9b-8994-f511430c7b90): created successfully Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d11813d-97e5-4153-904f-faa378ffab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Flow 'volume_create_manager' (d975e4b7-addb-4b05-ada6-069f5882f170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1d01401e-d6a5-4bfc-9231-f485225224e5 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Created volume successfully. Sep 28 12:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:15 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:10:15 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:15 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.384s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3a674303-c6dc-4a91-8f99-7b5bc1178ab9 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Retype volume completed successfully. Sep 28 12:10:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Acquiring lock "cinder-2bc05042-ecca-4a9b-8994-f511430c7b90-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "cinder-2bc05042-ecca-4a9b-8994-f511430c7b90-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Acquiring lock "cinder-quobyte-2bc05042-ecca-4a9b-8994-f511430c7b90" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "cinder-quobyte-2bc05042-ecca-4a9b-8994-f511430c7b90" acquired by "delete_volume" :: waited 0.040s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:16 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz8982imd/privsep.sock'] Sep 28 12:10:16 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz8982imd/privsep.sock Sep 28 12:10:16 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 12:10:18 devstack cinder-volume[87167]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 12:10:18 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:18 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Spawned new privsep daemon via rootwrap Sep 28 12:10:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Accepted privsep connection to /tmp/tmpz8982imd/privsep.sock {{(pid=87167) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 12:10:18 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 12:10:18 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 12:10:18 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 12:10:18 devstack cinder-volume[87167]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87898 Sep 28 12:10:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8231656d-2837-4e22-b8db-edb27af81c6a]: (2,) {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:10:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d48e2ff-23c7-49f5-9617-31bc557f5eae]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:10:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:18 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 Sep 28 12:10:18 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:19 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90" returned: 0 in 0.840s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:19 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90 Sep 28 12:10:19 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:19 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc05042-ecca-4a9b-8994-f511430c7b90" returned: 0 in 0.571s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "cinder-quobyte-2bc05042-ecca-4a9b-8994-f511430c7b90" released by "delete_volume" :: held 3.390s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:20 devstack cinder-volume[87167]: WARNING cinder.quota [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:10:20 devstack cinder-volume[87167]: WARNING cinder.quota [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Created reservations ['7d4f9355-017b-46b1-93ac-0bea6b1b04ef', '0746c8c8-96f2-499c-a4bb-285aadd73245', '76621c9e-b9c7-40ba-881a-5d40916ee5de', '77d324a8-6831-4940-bfb4-f26caf829976'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:20 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:10:20 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:20 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.551s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:20 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Deleted volume successfully. Sep 28 12:10:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-32265c4b-8909-47ca-8b41-408e4919a954 tempest-VolumeRetypeWithoutMigrationTest-569362842 None] Lock "cinder-2bc05042-ecca-4a9b-8994-f511430c7b90-delete_volume" released by "delete_volume" :: held 4.605s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:30 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=19,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:10:31 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=19,cinder:UPDATE=18,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Flow 'volume_create_manager' (a61aea1a-535b-4d1e-b756-0e05e4663544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc7f46c-fc83-47c7-977f-2db3e074116a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc7f46c-fc83-47c7-977f-2db3e074116a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1040273766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c50edd-e8f5-440f-85c2-3f4e2671c05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d139e76768454679a14ba6a01f26b26e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:40Z,use_quota=True,user_id='00c5ff897cef4c95a7d6c377c5dc3aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60d2899-4f22-4fd5-8fed-d4374486d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60d2899-4f22-4fd5-8fed-d4374486d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af185fff-5877-4327-b70e-ac947964988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af185fff-5877-4327-b70e-ac947964988c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c50edd-e8f5-440f-85c2-3f4e2671c05c', 'volume_name': 'volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eba1076-a329-40d0-9136-cb724abef21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eba1076-a329-40d0-9136-cb724abef21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087e0849-b2c4-4f92-8695-113f85205c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Volume c7c50edd-e8f5-440f-85c2-3f4e2671c05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c', 'volume_size': 1} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1040273766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c50edd-e8f5-440f-85c2-3f4e2671c05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d139e76768454679a14ba6a01f26b26e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:40Z,use_quota=True,user_id='00c5ff897cef4c95a7d6c377c5dc3aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Creating volume c7c50edd-e8f5-440f-85c2-3f4e2671c05c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:10:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:10:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:40 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c 1073741824 Sep 28 12:10:40 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:41 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c 1073741824" returned: 0 in 0.915s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:41 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c Sep 28 12:10:41 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:42 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c" returned: 0 in 0.405s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087e0849-b2c4-4f92-8695-113f85205c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1894a8ee-01c3-475b-a980-b15823603d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:42 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Volume volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c (c7c50edd-e8f5-440f-85c2-3f4e2671c05c): created successfully Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1894a8ee-01c3-475b-a980-b15823603d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Flow 'volume_create_manager' (a61aea1a-535b-4d1e-b756-0e05e4663544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3d148d86-3df7-4768-bbda-9714a3b240a4 tempest-VolumesServicesTestJSON-2032431768 None] Created volume successfully. Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Acquiring lock "cinder-c7c50edd-e8f5-440f-85c2-3f4e2671c05c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Lock "cinder-c7c50edd-e8f5-440f-85c2-3f4e2671c05c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Acquiring lock "cinder-quobyte-c7c50edd-e8f5-440f-85c2-3f4e2671c05c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Lock "cinder-quobyte-c7c50edd-e8f5-440f-85c2-3f4e2671c05c" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da866f7-afb7-441f-9611-1f2d5c93a578]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:10:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:43 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c Sep 28 12:10:43 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:43 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c" returned: 0 in 0.759s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:43 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c Sep 28 12:10:43 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:44 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c7c50edd-e8f5-440f-85c2-3f4e2671c05c" returned: 0 in 0.362s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Lock "cinder-quobyte-c7c50edd-e8f5-440f-85c2-3f4e2671c05c" released by "delete_volume" :: held 1.200s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:44 devstack cinder-volume[87167]: WARNING cinder.quota [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:10:44 devstack cinder-volume[87167]: WARNING cinder.quota [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Created reservations ['7e43fd3d-13d5-45c2-b843-1fabb7750ef4', '290b9245-8a7e-43de-9c94-cb0441fe8eea', '27916a5c-0bdd-464f-a130-ec9f55bca7e6', '45bb9ca2-a390-45c7-a78e-f1875e3bfb1e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:10:44 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:10:44 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Flow 'volume_create_manager' (7bd1b2d5-4f7a-4dac-b3fb-71d8f988f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0654ed-b33d-45b1-a0dc-02a4a39619a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0654ed-b33d-45b1-a0dc-02a4a39619a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1520302579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7811ad-bd0f-4b80-9611-5e1fdf4aa265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80dfa0466a4a4dec95ec52121df633d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:44Z,use_quota=True,user_id='741918dd00bd45f18479f35eee9c70e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764c925d-ff6b-40ed-847f-5c59471eb637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764c925d-ff6b-40ed-847f-5c59471eb637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087a0846-8ff0-4c38-a94c-9d08251d1a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087a0846-8ff0-4c38-a94c-9d08251d1a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a7811ad-bd0f-4b80-9611-5e1fdf4aa265', 'volume_name': 'volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb98503-88b8-42ae-9582-bca0ec608124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb98503-88b8-42ae-9582-bca0ec608124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82217b8-861b-40ec-b8ee-01b05959beee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:44 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Volume 1a7811ad-bd0f-4b80-9611-5e1fdf4aa265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265', 'volume_size': 1} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1520302579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7811ad-bd0f-4b80-9611-5e1fdf4aa265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80dfa0466a4a4dec95ec52121df633d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:44Z,use_quota=True,user_id='741918dd00bd45f18479f35eee9c70e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Creating volume 1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:10:44 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:44 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 1073741824 Sep 28 12:10:44 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:44 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Deleted volume successfully. Sep 28 12:10:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6f66ee71-09d6-4d7d-8e75-c8b30a4f79a2 tempest-VolumesServicesTestJSON-2032431768 None] Lock "cinder-c7c50edd-e8f5-440f-85c2-3f4e2671c05c-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:45 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 1073741824" returned: 0 in 0.622s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:45 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 Sep 28 12:10:45 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:45 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265" returned: 0 in 0.416s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82217b8-861b-40ec-b8ee-01b05959beee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d390bf-5f8a-40cc-a9cf-2a02f26a9745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Volume volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 (1a7811ad-bd0f-4b80-9611-5e1fdf4aa265): created successfully Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d390bf-5f8a-40cc-a9cf-2a02f26a9745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Flow 'volume_create_manager' (7bd1b2d5-4f7a-4dac-b3fb-71d8f988f873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7ca16c75-fe40-4256-a837-e706f24ad390 tempest-ServersNegativeTestJSON-186894173 None] Created volume successfully. Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:49 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:10:49 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:49 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.390s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:10:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Flow 'volume_create_manager' (41461ef9-a9f5-49e6-bc9d-912ba0977977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645a36da-0b3d-462f-822d-f9de19a6cb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645a36da-0b3d-462f-822d-f9de19a6cb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-764367928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9e7997-9f79-4a7e-8a44-026b91f1a47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80dfa0466a4a4dec95ec52121df633d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:50Z,use_quota=True,user_id='741918dd00bd45f18479f35eee9c70e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9042b7a-9ecf-4d2d-81d0-d7d26e1d0415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9042b7a-9ecf-4d2d-81d0-d7d26e1d0415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab83a89-9741-479d-bb84-0aff55a95c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab83a89-9741-479d-bb84-0aff55a95c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9e7997-9f79-4a7e-8a44-026b91f1a47a', 'volume_name': 'volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3d0cef-bfad-451e-abc2-6e2b088edc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3d0cef-bfad-451e-abc2-6e2b088edc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a767a07f-f414-4a40-b747-3d1f0e9573dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Volume 3b9e7997-9f79-4a7e-8a44-026b91f1a47a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a', 'volume_size': 1} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-764367928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9e7997-9f79-4a7e-8a44-026b91f1a47a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80dfa0466a4a4dec95ec52121df633d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:50Z,use_quota=True,user_id='741918dd00bd45f18479f35eee9c70e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Creating volume 3b9e7997-9f79-4a7e-8a44-026b91f1a47a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:10:50 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:10:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:50 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a 1073741824 Sep 28 12:10:50 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:51 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a 1073741824" returned: 0 in 0.747s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:51 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a Sep 28 12:10:51 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:51 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a" returned: 0 in 0.357s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a767a07f-f414-4a40-b747-3d1f0e9573dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319244c0-fd10-4b9d-9506-9f18519412a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Volume volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a (3b9e7997-9f79-4a7e-8a44-026b91f1a47a): created successfully Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319244c0-fd10-4b9d-9506-9f18519412a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Flow 'volume_create_manager' (41461ef9-a9f5-49e6-bc9d-912ba0977977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3dbd0345-9c02-4bee-8b17-f918578dc51b tempest-ServersNegativeTestJSON-186894173 None] Created volume successfully. Sep 28 12:10:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "cinder-3b9e7997-9f79-4a7e-8a44-026b91f1a47a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Lock "cinder-3b9e7997-9f79-4a7e-8a44-026b91f1a47a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "cinder-quobyte-3b9e7997-9f79-4a7e-8a44-026b91f1a47a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Lock "cinder-quobyte-3b9e7997-9f79-4a7e-8a44-026b91f1a47a" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2643480-beca-465a-b077-cc3630528447]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:53 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a Sep 28 12:10:53 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:53 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a" returned: 0 in 0.510s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:53 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a Sep 28 12:10:53 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:53 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3b9e7997-9f79-4a7e-8a44-026b91f1a47a" returned: 0 in 0.266s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Lock "cinder-quobyte-3b9e7997-9f79-4a7e-8a44-026b91f1a47a" released by "delete_volume" :: held 0.852s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Created reservations ['b1eebe06-5b1d-49a1-ba64-ffcd87db3e87', '922053ab-50cd-4dd6-88b3-061fd67fb7b8', 'e5238b4c-f944-47bc-b164-3d01f997aee5', 'b0743542-ecf3-4fee-87b5-9c6a1677a4d3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:54 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:10:54 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "cinder-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Lock "cinder-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "cinder-quobyte-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Lock "cinder-quobyte-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc23084-ef0d-47cd-8406-5cd97b80cb63]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:54 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Deleted volume successfully. Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cb8d50f6-1b2f-4fff-b070-db290cf7d588 tempest-ServersNegativeTestJSON-186894173 None] Lock "cinder-3b9e7997-9f79-4a7e-8a44-026b91f1a47a-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:54 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 Sep 28 12:10:54 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:54 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265" returned: 0 in 0.449s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:54 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265 Sep 28 12:10:54 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Flow 'volume_create_manager' (8d249027-f216-4947-adda-94347185c01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f17c4f-8bd4-442d-b202-ac2671fe1528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f17c4f-8bd4-442d-b202-ac2671fe1528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-888872249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980d8c3e-36ee-4506-8fd7-2a16b595f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefc4c1d85244d35ae99ba1df4525d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:55Z,use_quota=True,user_id='74c310228c1b47fbad0f16b21aa5f808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fea12d5-816b-4a17-9140-716c9f676870),volume_type_id=7fea12d5-816b-4a17-9140-716c9f676870)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155f8a4c-e1bd-48ec-bd25-2534aa4a31c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155f8a4c-e1bd-48ec-bd25-2534aa4a31c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16147413-2a10-4a3a-9ac8-0e0443c9abaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16147413-2a10-4a3a-9ac8-0e0443c9abaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980d8c3e-36ee-4506-8fd7-2a16b595f109', 'volume_name': 'volume-980d8c3e-36ee-4506-8fd7-2a16b595f109', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb856af-c521-4b9f-a399-4150f4e2f1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb856af-c521-4b9f-a399-4150f4e2f1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2011fbe7-a8e5-48cd-b210-5c122ba866c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Volume 980d8c3e-36ee-4506-8fd7-2a16b595f109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980d8c3e-36ee-4506-8fd7-2a16b595f109', 'volume_size': 1} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-888872249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980d8c3e-36ee-4506-8fd7-2a16b595f109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefc4c1d85244d35ae99ba1df4525d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:10:55Z,use_quota=True,user_id='74c310228c1b47fbad0f16b21aa5f808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fea12d5-816b-4a17-9140-716c9f676870),volume_type_id=7fea12d5-816b-4a17-9140-716c9f676870)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Creating volume 980d8c3e-36ee-4506-8fd7-2a16b595f109 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:10:55 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:55 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265" returned: 0 in 0.339s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:55 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 1073741824 Sep 28 12:10:55 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Lock "cinder-quobyte-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265" released by "delete_volume" :: held 0.863s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Created reservations ['116f10cd-9190-43c8-b2c7-aec22715608c', '733f5bec-f5aa-4e4b-af15-9cdb7f567c38', '89c82e16-4554-497f-9be4-1e496064b00a', 'ce950c39-494b-4a8d-8eea-094417891e29'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:55 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:10:55 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:55 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 1073741824" returned: 0 in 0.634s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:55 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 Sep 28 12:10:55 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:55 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.450s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:55 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Deleted volume successfully. Sep 28 12:10:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38b082fc-f591-45f3-aad9-f46aee6a4041 tempest-ServersNegativeTestJSON-186894173 None] Lock "cinder-1a7811ad-bd0f-4b80-9611-5e1fdf4aa265-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:56 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109" returned: 0 in 0.332s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:10:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2011fbe7-a8e5-48cd-b210-5c122ba866c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980d8c3e-36ee-4506-8fd7-2a16b595f109', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ed49ee-1c6f-4532-9797-6560de26ec05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:10:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Volume volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 (980d8c3e-36ee-4506-8fd7-2a16b595f109): created successfully Sep 28 12:10:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ed49ee-1c6f-4532-9797-6560de26ec05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:10:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Flow 'volume_create_manager' (8d249027-f216-4947-adda-94347185c01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:10:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fefc61ec-fd9e-4e93-9a62-a83cebb9883b tempest-VolumeTypesAccessTest-1272557353 None] Created volume successfully. Sep 28 12:10:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Acquiring lock "cinder-980d8c3e-36ee-4506-8fd7-2a16b595f109-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Lock "cinder-980d8c3e-36ee-4506-8fd7-2a16b595f109-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Acquiring lock "cinder-quobyte-980d8c3e-36ee-4506-8fd7-2a16b595f109" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:10:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Lock "cinder-quobyte-980d8c3e-36ee-4506-8fd7-2a16b595f109" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:10:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed96a9-a9e5-429a-b219-fbd7a60b16f2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:10:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:57 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 Sep 28 12:10:57 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:57 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109" returned: 0 in 0.581s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:58 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109 Sep 28 12:10:58 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:58 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-980d8c3e-36ee-4506-8fd7-2a16b595f109" returned: 0 in 0.367s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Lock "cinder-quobyte-980d8c3e-36ee-4506-8fd7-2a16b595f109" released by "delete_volume" :: held 1.037s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:10:58 devstack cinder-volume[87167]: WARNING cinder.quota [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-603608320 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-603608320, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:10:58 devstack cinder-volume[87167]: WARNING cinder.quota [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-603608320 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-603608320, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Created reservations ['71bae303-cc81-4baa-a8e0-fed3a2cc3fbe', 'dc068592-284a-4f04-aed3-474320a0af22', '84efb9ba-7ef9-41c8-bc88-08120207a19b', '7a44a7d3-c164-40a0-a9ad-f9fb99a09737'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:58 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:10:58 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:58 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Deleted volume successfully. Sep 28 12:10:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-214918c5-4e4b-44b0-b802-38d08985cdcf tempest-VolumeTypesAccessTest-1272557353 None] Lock "cinder-980d8c3e-36ee-4506-8fd7-2a16b595f109-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:11:08 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=27,cinder:UPDATE=43,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:11:08 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=29,cinder:UPDATE=45,cinder:INSERT=8,cinder:DELETE=6 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:11:21 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:11:21 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:11:30 devstack cinder-volume[87167]: WARNING py.warnings [req-e6c13ed2-bd06-4a87-baaf-df8b9f5292a9 req-e6b5c268-0b6e-4294-b185-c38d23d2ec51 tempest-TaggedAttachmentsTest-1499180902 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 12:11:30 devstack cinder-volume[87167]: .first() Sep 28 12:11:30 devstack cinder-volume[87167]: Sep 28 12:11:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e6c13ed2-bd06-4a87-baaf-df8b9f5292a9 req-e6b5c268-0b6e-4294-b185-c38d23d2ec51 tempest-TaggedAttachmentsTest-1499180902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e6c13ed2-bd06-4a87-baaf-df8b9f5292a9 req-e6b5c268-0b6e-4294-b185-c38d23d2ec51 tempest-TaggedAttachmentsTest-1499180902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e6c13ed2-bd06-4a87-baaf-df8b9f5292a9 req-e6b5c268-0b6e-4294-b185-c38d23d2ec51 tempest-TaggedAttachmentsTest-1499180902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-e6c13ed2-bd06-4a87-baaf-df8b9f5292a9 req-e6b5c268-0b6e-4294-b185-c38d23d2ec51 tempest-TaggedAttachmentsTest-1499180902 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfb24573-df6d-43ba-bf05-6642db7d98b0', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:11:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-e6c13ed2-bd06-4a87-baaf-df8b9f5292a9 req-e6b5c268-0b6e-4294-b185-c38d23d2ec51 tempest-TaggedAttachmentsTest-1499180902 None] attachment_update completed successfully. Sep 28 12:11:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-c42b41a5-806c-48f0-812b-5b3b89d778ca req-b619475c-ef42-4a30-9c5f-939a21e1b028 tempest-TaggedAttachmentsTest-1499180902 None] Terminate volume connection completed successfully. Sep 28 12:11:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-c42b41a5-806c-48f0-812b-5b3b89d778ca req-b619475c-ef42-4a30-9c5f-939a21e1b028 tempest-TaggedAttachmentsTest-1499180902 None] Deleting attachment cfb24573-df6d-43ba-bf05-6642db7d98b0. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Flow 'volume_create_manager' (aba3dbef-28d7-4e92-a353-b49d4058e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95990981-5b31-4db5-9d2e-91d2ae789b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95990981-5b31-4db5-9d2e-91d2ae789b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1624067543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae998e92-95c4-455f-8ae3-980cba2b57c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25db84ace914e2a805deed43e4deebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:11:41Z,use_quota=True,user_id='61b113328ad645408b502953e5cd338d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a8a6d8-01f2-49cd-987f-f40160b2cf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a8a6d8-01f2-49cd-987f-f40160b2cf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a8498f-d175-433e-95a5-34a3e045067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a8498f-d175-433e-95a5-34a3e045067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae998e92-95c4-455f-8ae3-980cba2b57c7', 'volume_name': 'volume-ae998e92-95c4-455f-8ae3-980cba2b57c7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bc2665-0031-4d74-85d5-c44cb077da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bc2665-0031-4d74-85d5-c44cb077da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0b1c35-27be-4178-8687-13e078de4b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Volume ae998e92-95c4-455f-8ae3-980cba2b57c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae998e92-95c4-455f-8ae3-980cba2b57c7', 'volume_size': 1} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1624067543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae998e92-95c4-455f-8ae3-980cba2b57c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25db84ace914e2a805deed43e4deebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:11:41Z,use_quota=True,user_id='61b113328ad645408b502953e5cd338d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Creating volume ae998e92-95c4-455f-8ae3-980cba2b57c7 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:11:41 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:11:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:41 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 1073741824 Sep 28 12:11:41 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:42 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 1073741824" returned: 0 in 1.005s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:42 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 Sep 28 12:11:42 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:43 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7" returned: 0 in 0.727s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:11:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0b1c35-27be-4178-8687-13e078de4b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae998e92-95c4-455f-8ae3-980cba2b57c7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd0c643-7ac7-409c-8dc3-3ed73c791ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Volume volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 (ae998e92-95c4-455f-8ae3-980cba2b57c7): created successfully Sep 28 12:11:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd0c643-7ac7-409c-8dc3-3ed73c791ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Flow 'volume_create_manager' (aba3dbef-28d7-4e92-a353-b49d4058e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:11:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-abb97a2d-d3b4-48f8-8588-bc9384b40de0 tempest-VolumesAdminNegativeTest-1681665920 None] Created volume successfully. Sep 28 12:11:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Acquiring lock "cinder-ae998e92-95c4-455f-8ae3-980cba2b57c7-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:11:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "cinder-ae998e92-95c4-455f-8ae3-980cba2b57c7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:11:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Acquiring lock "cinder-quobyte-ae998e92-95c4-455f-8ae3-980cba2b57c7" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:11:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "cinder-quobyte-ae998e92-95c4-455f-8ae3-980cba2b57c7" acquired by "delete_volume" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:11:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf88cf6e-b5eb-4a01-8269-135b6d5858b8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:11:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:45 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 Sep 28 12:11:45 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:46 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7" returned: 0 in 0.956s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:46 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7 Sep 28 12:11:46 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:47 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ae998e92-95c4-455f-8ae3-980cba2b57c7" returned: 0 in 0.727s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "cinder-quobyte-ae998e92-95c4-455f-8ae3-980cba2b57c7" released by "delete_volume" :: held 1.807s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Created reservations ['61d78b72-6e0e-4689-87f2-5484689bc3f0', 'd052fa15-c22c-4eb8-8d6e-551896568ff1', 'a233eab0-85f9-43dd-97ed-f468930b2124', 'd982d412-323a-49b9-a5c1-70e437f6f2d6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:47 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:11:47 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:48 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.768s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:48 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:11:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Deleted volume successfully. Sep 28 12:11:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-85a3f00f-f756-49d8-89c7-aa0b1eb036a1 tempest-VolumesAdminNegativeTest-1681665920 None] Lock "cinder-ae998e92-95c4-455f-8ae3-980cba2b57c7-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:49 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:11:49 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Flow 'volume_create_manager' (e6804ce6-e5bc-4837-a532-735d4bfecc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd30deb9-73d5-4306-bd10-df7f285d267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd30deb9-73d5-4306-bd10-df7f285d267f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-9337334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813cb826-945d-4b3e-a01c-a210ac8d7c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b39aaec8b254796949ad5e9e69fe215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:11:50Z,use_quota=True,user_id='66602f04cd5e44598cc24a724260d010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b35fcee-bdc0-4566-86c1-ce6bc53da59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b35fcee-bdc0-4566-86c1-ce6bc53da59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a461cfc-1aef-4792-bf24-a723fe2309b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a461cfc-1aef-4792-bf24-a723fe2309b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813cb826-945d-4b3e-a01c-a210ac8d7c81', 'volume_name': 'volume-813cb826-945d-4b3e-a01c-a210ac8d7c81', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33ea2b4-245c-454a-a217-57589102f2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33ea2b4-245c-454a-a217-57589102f2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809066a0-cf90-40f9-882f-598a032ec9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Volume 813cb826-945d-4b3e-a01c-a210ac8d7c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813cb826-945d-4b3e-a01c-a210ac8d7c81', 'volume_size': 1} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-9337334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813cb826-945d-4b3e-a01c-a210ac8d7c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b39aaec8b254796949ad5e9e69fe215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:11:50Z,use_quota=True,user_id='66602f04cd5e44598cc24a724260d010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Creating volume 813cb826-945d-4b3e-a01c-a210ac8d7c81 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:11:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:11:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:49 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 1073741824 Sep 28 12:11:49 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:50 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.609s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:11:51 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 1073741824" returned: 0 in 1.256s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:51 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 Sep 28 12:11:51 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:51 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81" returned: 0 in 0.353s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809066a0-cf90-40f9-882f-598a032ec9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813cb826-945d-4b3e-a01c-a210ac8d7c81', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d90cd0c-e879-426f-8833-65f3ec705100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:11:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Volume volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 (813cb826-945d-4b3e-a01c-a210ac8d7c81): created successfully Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d90cd0c-e879-426f-8833-65f3ec705100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:11:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Flow 'volume_create_manager' (e6804ce6-e5bc-4837-a532-735d4bfecc02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:11:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ac773672-c927-4127-b5c5-1e761dc45ddc tempest-SnapshotMetadataTestJSON-1822522481 None] Created volume successfully. Sep 28 12:11:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Creating offline snapshot 2c5821a5-0163-44f5-b044-8972cc95b6af of volume 813cb826-945d-4b3e-a01c-a210ac8d7c81 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:11:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aee3fe-686c-4c44-a5ac-af3b0e536aea]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:11:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:53 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 Sep 28 12:11:53 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:53 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81" returned: 0 in 0.470s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:53 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af 1G Sep 28 12:11:53 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:54 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af 1G" returned: 0 in 0.682s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:54 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af Sep 28 12:11:54 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:54 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af" returned: 0 in 0.425s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:54 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af is being set with open permissions: ugo+rw Sep 28 12:11:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:54 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af Sep 28 12:11:54 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:55 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af" returned: 0 in 0.437s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:55 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.info Sep 28 12:11:55 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Acquiring lock "cinder-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Lock "cinder-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Acquiring lock "cinder-quobyte-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Lock "cinder-quobyte-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:11:55 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.info" returned: 0 in 0.484s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:55 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.info is being set with open permissions: ugo+rw Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[54920fae-07fd-45b3-ac69-4b329c2958a0]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:11:55 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.info Sep 28 12:11:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:55 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:55 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 Sep 28 12:11:55 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:56 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.info" returned: 0 in 0.415s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-576bd9ec-4094-4b96-addf-cae43a79e78c tempest-SnapshotMetadataTestJSON-1822522481 None] Create snapshot completed successfully Sep 28 12:11:56 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4" returned: 0 in 0.513s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:56 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4 Sep 28 12:11:56 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:56 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4" returned: 0 in 0.399s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Lock "cinder-quobyte-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4" released by "delete_volume" :: held 0.997s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Created reservations ['8f3849cb-6847-4bc3-b8e6-7a825c87f4f5', '963ed525-3e16-4daa-beb6-88fda6ab11b1', '6c4e051e-f924-4289-bc51-c7108ba04800', 'e355d625-d4d8-4ca4-8338-041c201835aa'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:57 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:11:57 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:57 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.330s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:11:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Deleted volume successfully. Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f441ce20-e6aa-4541-9329-744336bfa794 tempest-TaggedAttachmentsTest-1499180902 None] Lock "cinder-4de2e33d-e4ab-4d0b-9d87-dca741a5a8b4-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "cinder-2c5821a5-0163-44f5-b044-8972cc95b6af-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-2c5821a5-0163-44f5-b044-8972cc95b6af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "cinder-quobyte-813cb826-945d-4b3e-a01c-a210ac8d7c81" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-quobyte-813cb826-945d-4b3e-a01c-a210ac8d7c81" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "cinder-quobyte-2c5821a5-0163-44f5-b044-8972cc95b6af" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-quobyte-2c5821a5-0163-44f5-b044-8972cc95b6af" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Deleting offline snapshot 2c5821a5-0163-44f5-b044-8972cc95b6af of volume 813cb826-945d-4b3e-a01c-a210ac8d7c81 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] snapshot_file for this snap is: volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed43e21-7861-40a1-8e93-7d2537508d18]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:11:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:57 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af Sep 28 12:11:57 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:58 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af" returned: 0 in 0.478s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-813cb826-945d-4b3e-a01c-a210ac8d7c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:11:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d00582-f55f-4670-83e4-f130010dbde2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:11:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:58 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 Sep 28 12:11:58 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:58 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81" returned: 0 in 0.503s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:58 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af Sep 28 12:11:58 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:59 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af" returned: 0 in 0.549s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:59 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af Sep 28 12:11:59 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:59 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81.2c5821a5-0163-44f5-b044-8972cc95b6af" returned: 0 in 0.479s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-quobyte-2c5821a5-0163-44f5-b044-8972cc95b6af" released by "_delete_snapshot" :: held 2.242s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:11:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-quobyte-813cb826-945d-4b3e-a01c-a210ac8d7c81" released by "delete_snapshot" :: held 2.273s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:11:59 devstack cinder-volume[87167]: WARNING cinder.quota [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:11:59 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Created reservations ['e8cae431-eeb0-46ce-9d0b-d53dacd545fc', '323cfb89-3a7d-4514-a4c0-eeafe92d6cbc', '05aac5c5-9f30-4122-9318-a1494de762da', '0f2c5ee7-075b-4f2b-8e5e-da59b930df14'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:11:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Delete snapshot completed successfully. Sep 28 12:11:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-124eb1f2-f29f-463a-9151-9571f3bf550e tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-2c5821a5-0163-44f5-b044-8972cc95b6af-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "cinder-813cb826-945d-4b3e-a01c-a210ac8d7c81-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-813cb826-945d-4b3e-a01c-a210ac8d7c81-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "cinder-quobyte-813cb826-945d-4b3e-a01c-a210ac8d7c81" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-quobyte-813cb826-945d-4b3e-a01c-a210ac8d7c81" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc1b956-305b-4d7d-8404-eb59b5955d36]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:12:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:01 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 Sep 28 12:12:01 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:01 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81" returned: 0 in 0.451s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:01 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81 Sep 28 12:12:01 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:01 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-813cb826-945d-4b3e-a01c-a210ac8d7c81" returned: 0 in 0.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-quobyte-813cb826-945d-4b3e-a01c-a210ac8d7c81" released by "delete_volume" :: held 0.844s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Created reservations ['177791c7-7887-48cf-9d04-87a5be392373', '4294f79e-ce37-470b-bcf3-9cfcd5ccdf6a', 'ec898a73-5898-4533-b838-e3fbbfd8309b', '96d036aa-afae-4ff4-a44f-77b460e1f61b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:01 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:12:01 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:02 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.326s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:02 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:12:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Deleted volume successfully. Sep 28 12:12:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ec8adfb-61c3-467b-a41f-807029581fcf tempest-SnapshotMetadataTestJSON-1822522481 None] Lock "cinder-813cb826-945d-4b3e-a01c-a210ac8d7c81-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Flow 'volume_create_manager' (834d272c-7f7f-49d2-b9d0-11e40a83efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f31d18e-3217-4a1e-87e6-3ce85d06670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f31d18e-3217-4a1e-87e6-3ce85d06670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-53552313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2927ca3-6dca-4f53-9d42-2623e24eac2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e60035aace34cf39343ecb9017232c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:08Z,use_quota=True,user_id='45eb83a680544ac1be03dcd5234daab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bec01e7-ce1a-4109-bbfb-79914ffbf49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bec01e7-ce1a-4109-bbfb-79914ffbf49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090a79cf-37f7-470d-b708-c51fd26a8d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090a79cf-37f7-470d-b708-c51fd26a8d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2927ca3-6dca-4f53-9d42-2623e24eac2c', 'volume_name': 'volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c', 'volume_size': 2}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dceace-bc38-4c7f-bc7e-592b6de06d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dceace-bc38-4c7f-bc7e-592b6de06d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33e4831-1380-427d-9eca-78a6756e5f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Volume b2927ca3-6dca-4f53-9d42-2623e24eac2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c', 'volume_size': 2} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-53552313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2927ca3-6dca-4f53-9d42-2623e24eac2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e60035aace34cf39343ecb9017232c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:08Z,use_quota=True,user_id='45eb83a680544ac1be03dcd5234daab6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Creating volume b2927ca3-6dca-4f53-9d42-2623e24eac2c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:12:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c 2147483648 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:07 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c 2147483648 Sep 28 12:12:07 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:08 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c 2147483648" returned: 0 in 0.718s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:08 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c Sep 28 12:12:08 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:08 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c" returned: 0 in 0.387s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c33e4831-1380-427d-9eca-78a6756e5f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c', 'volume_size': 2}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b0935f-5169-482c-90eb-346c3cc4033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Volume volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c (b2927ca3-6dca-4f53-9d42-2623e24eac2c): created successfully Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b0935f-5169-482c-90eb-346c3cc4033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Flow 'volume_create_manager' (834d272c-7f7f-49d2-b9d0-11e40a83efe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e2470487-e505-4521-959e-ad2c5ec3d56b tempest-VolumesCloneNegativeTest-1005766816 None] Created volume successfully. Sep 28 12:12:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Acquiring lock "cinder-b2927ca3-6dca-4f53-9d42-2623e24eac2c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Lock "cinder-b2927ca3-6dca-4f53-9d42-2623e24eac2c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Acquiring lock "cinder-quobyte-b2927ca3-6dca-4f53-9d42-2623e24eac2c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Lock "cinder-quobyte-b2927ca3-6dca-4f53-9d42-2623e24eac2c" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bac67c7-aae8-42e1-9c16-f24eb4a3380d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:12:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:10 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c Sep 28 12:12:10 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:10 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c" returned: 0 in 0.570s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:10 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c Sep 28 12:12:10 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:11 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2927ca3-6dca-4f53-9d42-2623e24eac2c" returned: 0 in 0.389s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Lock "cinder-quobyte-b2927ca3-6dca-4f53-9d42-2623e24eac2c" released by "delete_volume" :: held 1.033s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Created reservations ['b18d1337-31f8-4230-8492-5a0cefde6b76', '772dfb65-3962-400b-8ca7-9ed3fc24105d', 'ad2cd4cb-e862-4fad-a9c4-9b8bfd70fc82', '98f06d0b-7b2c-4e34-94f9-44d507c47c06'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:11 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:12:11 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:11 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.341s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:12:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Deleted volume successfully. Sep 28 12:12:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dcb6490-4d20-4ee5-a977-614218b2c5cc tempest-VolumesCloneNegativeTest-1005766816 None] Lock "cinder-b2927ca3-6dca-4f53-9d42-2623e24eac2c-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Flow 'volume_create_manager' (1b2fea70-fcc3-4555-9d5a-683895485f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64529915-e4c7-4906-91af-48b63c2fe7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64529915-e4c7-4906-91af-48b63c2fe7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1507301383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567ce613-d8f4-4d12-9d1b-24efaf4d7b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42de3bacac2e44cc91d5f422d81d1ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:13Z,use_quota=True,user_id='09b72d1399044ab7b307c601a8c88345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71fb832-9618-4a92-84ec-c3bdca57662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71fb832-9618-4a92-84ec-c3bdca57662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1a115f-6bf1-4a70-b40e-80723abbbfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1a115f-6bf1-4a70-b40e-80723abbbfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567ce613-d8f4-4d12-9d1b-24efaf4d7b82', 'volume_name': 'volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7942eb09-e92b-4b95-8cb6-a1d78fdebc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7942eb09-e92b-4b95-8cb6-a1d78fdebc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67baca5e-990d-4f3a-8c85-9f9d5f6c35ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Volume 567ce613-d8f4-4d12-9d1b-24efaf4d7b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82', 'volume_size': 1} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1507301383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567ce613-d8f4-4d12-9d1b-24efaf4d7b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42de3bacac2e44cc91d5f422d81d1ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:13Z,use_quota=True,user_id='09b72d1399044ab7b307c601a8c88345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Creating volume 567ce613-d8f4-4d12-9d1b-24efaf4d7b82 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:12 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:12:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:12 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 1073741824 Sep 28 12:12:12 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:13 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 1073741824" returned: 0 in 0.524s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:13 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 Sep 28 12:12:13 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:13 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82" returned: 0 in 0.313s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67baca5e-990d-4f3a-8c85-9f9d5f6c35ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052b3832-db4a-4500-a211-370b2a8cffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Volume volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 (567ce613-d8f4-4d12-9d1b-24efaf4d7b82): created successfully Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052b3832-db4a-4500-a211-370b2a8cffd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Flow 'volume_create_manager' (1b2fea70-fcc3-4555-9d5a-683895485f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3c768cf6-f631-4ca4-8b34-34222370249b tempest-AttachVolumeShelveTestJSON-1847278226 None] Created volume successfully. Sep 28 12:12:23 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=39,cinder:UPDATE=59,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:12:23 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=50,cinder:UPDATE=46,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Flow 'volume_create_manager' (1beb6a05-eb1f-4525-876b-0551b621dc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce26a7df-c068-42e4-9d9a-26b6580fed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce26a7df-c068-42e4-9d9a-26b6580fed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1806491012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230efe03-b587-4823-a535-91ec6ccde38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9401a3ae4c97484890e11beed3671a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:25Z,use_quota=True,user_id='40ed9637b0614f358e3b786186ba403b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c2bb32-ccea-4e57-aab8-81056889f592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c2bb32-ccea-4e57-aab8-81056889f592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e8e1d3-4490-48ef-b86a-2a7a3160e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e8e1d3-4490-48ef-b86a-2a7a3160e495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '230efe03-b587-4823-a535-91ec6ccde38f', 'volume_name': 'volume-230efe03-b587-4823-a535-91ec6ccde38f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f0a2dd-d489-451b-ab1e-a0008e54e795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f0a2dd-d489-451b-ab1e-a0008e54e795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12961793-1512-4b64-bc59-2974a2081db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Volume 230efe03-b587-4823-a535-91ec6ccde38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-230efe03-b587-4823-a535-91ec6ccde38f', 'volume_size': 1} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1806491012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230efe03-b587-4823-a535-91ec6ccde38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9401a3ae4c97484890e11beed3671a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:25Z,use_quota=True,user_id='40ed9637b0614f358e3b786186ba403b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Creating volume 230efe03-b587-4823-a535-91ec6ccde38f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:25 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:12:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:25 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f 1073741824 Sep 28 12:12:25 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:26 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f 1073741824" returned: 0 in 0.573s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:26 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f Sep 28 12:12:26 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:26 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f" returned: 0 in 0.362s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12961793-1512-4b64-bc59-2974a2081db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230efe03-b587-4823-a535-91ec6ccde38f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fa631e-051c-46d0-a8dc-0f8269ef2712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Volume volume-230efe03-b587-4823-a535-91ec6ccde38f (230efe03-b587-4823-a535-91ec6ccde38f): created successfully Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fa631e-051c-46d0-a8dc-0f8269ef2712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Flow 'volume_create_manager' (1beb6a05-eb1f-4525-876b-0551b621dc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bd5b47f4-7ec7-4310-8e8d-a66e74f465b7 tempest-VolumesNegativeTest-1239500328 None] Created volume successfully. Sep 28 12:12:36 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:12:36 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:12:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-82227711-ff06-426b-8691-4ca262ee8a4f req-e24649bb-ac3c-4828-b396-a15ccd83c879 tempest-AttachVolumeShelveTestJSON-1847278226 None] No connector for attachment ac8089ae-9f0d-4c3c-8b61-2a5dc48d2aba; skipping storage backend terminate_connection call. {{(pid=87167) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 12:12:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-82227711-ff06-426b-8691-4ca262ee8a4f req-e24649bb-ac3c-4828-b396-a15ccd83c879 tempest-AttachVolumeShelveTestJSON-1847278226 None] Deleting attachment ac8089ae-9f0d-4c3c-8b61-2a5dc48d2aba. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:12:48 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:12:48 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:12:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:12:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:49 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:12:49 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:50 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.646s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:12:50 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:12:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:12:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Flow 'volume_create_manager' (8aed347b-ec1a-469b-9f78-95885fb0467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f655af19-db88-4ac7-8c5b-490cc7694fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f655af19-db88-4ac7-8c5b-490cc7694fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1113308414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e25eea-4840-46ad-ae09-50cfc082d990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de06e0d4c10a455c868c5dd95b7283ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:01Z,use_quota=True,user_id='5d29b0f1c6474665a2509c0604795bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7afac69-7b77-4d7e-9f75-32d5c5bb8e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7afac69-7b77-4d7e-9f75-32d5c5bb8e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee4259f-b7ad-4dc3-abfb-bf31d2358033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee4259f-b7ad-4dc3-abfb-bf31d2358033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88e25eea-4840-46ad-ae09-50cfc082d990', 'volume_name': 'volume-88e25eea-4840-46ad-ae09-50cfc082d990', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237e8db0-8544-4598-96f9-32d7de1c6a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237e8db0-8544-4598-96f9-32d7de1c6a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fe147a-a783-42fe-91f6-0d0101b3d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Volume 88e25eea-4840-46ad-ae09-50cfc082d990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88e25eea-4840-46ad-ae09-50cfc082d990', 'volume_size': 1} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1113308414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88e25eea-4840-46ad-ae09-50cfc082d990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de06e0d4c10a455c868c5dd95b7283ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:01Z,use_quota=True,user_id='5d29b0f1c6474665a2509c0604795bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Creating volume 88e25eea-4840-46ad-ae09-50cfc082d990 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:13:01 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:13:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:01 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 1073741824 Sep 28 12:13:01 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:02 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 1073741824" returned: 0 in 1.250s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:02 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 Sep 28 12:13:02 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:03 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990" returned: 0 in 0.734s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:13:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fe147a-a783-42fe-91f6-0d0101b3d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88e25eea-4840-46ad-ae09-50cfc082d990', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b221bc-f60e-4875-a94b-f9b371567a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Volume volume-88e25eea-4840-46ad-ae09-50cfc082d990 (88e25eea-4840-46ad-ae09-50cfc082d990): created successfully Sep 28 12:13:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b221bc-f60e-4875-a94b-f9b371567a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Flow 'volume_create_manager' (8aed347b-ec1a-469b-9f78-95885fb0467e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-56825a30-f2a9-4995-8540-39083533ed78 tempest-DeleteServersTestJSON-1906163439 None] Created volume successfully. Sep 28 12:13:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-6fa91bbd-46af-483d-8d88-ade024c57840 req-8b9c7c66-c013-429f-95eb-796008e3ad30 tempest-DeleteServersTestJSON-1906163439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-6fa91bbd-46af-483d-8d88-ade024c57840 req-8b9c7c66-c013-429f-95eb-796008e3ad30 tempest-DeleteServersTestJSON-1906163439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-6fa91bbd-46af-483d-8d88-ade024c57840 req-8b9c7c66-c013-429f-95eb-796008e3ad30 tempest-DeleteServersTestJSON-1906163439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-6fa91bbd-46af-483d-8d88-ade024c57840 req-8b9c7c66-c013-429f-95eb-796008e3ad30 tempest-DeleteServersTestJSON-1906163439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-88e25eea-4840-46ad-ae09-50cfc082d990', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f122e44-649d-4221-85b5-bd37c6a0f396', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:13:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-6fa91bbd-46af-483d-8d88-ade024c57840 req-8b9c7c66-c013-429f-95eb-796008e3ad30 tempest-DeleteServersTestJSON-1906163439 None] attachment_update completed successfully. Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Flow 'volume_create_manager' (1a199942-aaf8-4dd3-b2f4-b06a43fd445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0b6692-f0df-4c24-9b0a-6b4a200c2879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b0b6692-f0df-4c24-9b0a-6b4a200c2879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2008079994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80422f5-2f81-4918-8169-a2b169c15342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a66aa51cb5e4c10b08c7b24d25d0224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:08Z,use_quota=True,user_id='ccd0b158ada840b4b3edfa9e10b46d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726e92c7-c75d-4cd9-961d-43cff8e9d3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726e92c7-c75d-4cd9-961d-43cff8e9d3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b78351f-0554-443f-bdbe-47496a2fa869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b78351f-0554-443f-bdbe-47496a2fa869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80422f5-2f81-4918-8169-a2b169c15342', 'volume_name': 'volume-c80422f5-2f81-4918-8169-a2b169c15342', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c52ffd-6c05-4268-a0d4-be6bd3110f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c52ffd-6c05-4268-a0d4-be6bd3110f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20cddab-1d4a-45cb-95f5-3c28d1ad7479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Volume c80422f5-2f81-4918-8169-a2b169c15342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80422f5-2f81-4918-8169-a2b169c15342', 'volume_size': 1} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2008079994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80422f5-2f81-4918-8169-a2b169c15342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a66aa51cb5e4c10b08c7b24d25d0224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:08Z,use_quota=True,user_id='ccd0b158ada840b4b3edfa9e10b46d65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Creating volume c80422f5-2f81-4918-8169-a2b169c15342 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:13:08 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:13:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:08 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 1073741824 Sep 28 12:13:08 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:10 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 1073741824" returned: 0 in 1.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:10 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 Sep 28 12:13:10 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:11 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342" returned: 0 in 0.868s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] <== create_volume: return (2764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:13:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.770s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20cddab-1d4a-45cb-95f5-3c28d1ad7479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80422f5-2f81-4918-8169-a2b169c15342', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3923fe6a-c54a-4b56-92f6-ce8e9c63c53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Volume volume-c80422f5-2f81-4918-8169-a2b169c15342 (c80422f5-2f81-4918-8169-a2b169c15342): created successfully Sep 28 12:13:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3923fe6a-c54a-4b56-92f6-ce8e9c63c53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Flow 'volume_create_manager' (1a199942-aaf8-4dd3-b2f4-b06a43fd445b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0319c4fa-0e6d-4ddf-8775-8dd9061f8ab3 tempest-ServerRescueNegativeTestJSON-190303626 None] Created volume successfully. Sep 28 12:13:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-ed6cb3d1-a907-4c7b-9bc6-2af7e974b4a8 req-e9c2b67d-fc4a-43f8-87fe-0fe4af0b9ddc tempest-DeleteServersTestJSON-1906163439 None] Terminate volume connection completed successfully. Sep 28 12:13:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ed6cb3d1-a907-4c7b-9bc6-2af7e974b4a8 req-e9c2b67d-fc4a-43f8-87fe-0fe4af0b9ddc tempest-DeleteServersTestJSON-1906163439 None] Deleting attachment 8f122e44-649d-4221-85b5-bd37c6a0f396. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:13:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Acquiring lock "cinder-88e25eea-4840-46ad-ae09-50cfc082d990-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Lock "cinder-88e25eea-4840-46ad-ae09-50cfc082d990-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Acquiring lock "cinder-quobyte-88e25eea-4840-46ad-ae09-50cfc082d990" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Lock "cinder-quobyte-88e25eea-4840-46ad-ae09-50cfc082d990" acquired by "delete_volume" :: waited 0.044s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f13ae-8d83-46a6-bbda-d24294b7750d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:21 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 Sep 28 12:13:21 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:22 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:22 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990 Sep 28 12:13:22 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Acquiring lock "cinder-230efe03-b587-4823-a535-91ec6ccde38f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Lock "cinder-230efe03-b587-4823-a535-91ec6ccde38f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Acquiring lock "cinder-quobyte-230efe03-b587-4823-a535-91ec6ccde38f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Lock "cinder-quobyte-230efe03-b587-4823-a535-91ec6ccde38f" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b85059d-42d4-4fd2-98c1-b6bb07d54623]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:22 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f Sep 28 12:13:22 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:22 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-88e25eea-4840-46ad-ae09-50cfc082d990" returned: 0 in 0.573s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Lock "cinder-quobyte-88e25eea-4840-46ad-ae09-50cfc082d990" released by "delete_volume" :: held 1.399s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Created reservations ['ff0c714e-87b4-48fa-9b1a-b469a90f3185', 'ed6eeb08-05a9-46ca-987f-c0f2d7a62cbf', 'fad205ec-8ed6-4ca5-a9bc-9cbf07f7961a', 'c66833cf-5575-4e1b-87e3-14314c2d8132'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:22 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f" returned: 0 in 0.583s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:22 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f Sep 28 12:13:23 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:23 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:13:23 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:23 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-230efe03-b587-4823-a535-91ec6ccde38f" returned: 0 in 0.513s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Lock "cinder-quobyte-230efe03-b587-4823-a535-91ec6ccde38f" released by "delete_volume" :: held 1.211s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:23 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.646s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Deleted volume successfully. Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Created reservations ['c2f4ee77-22fa-4864-911d-c27725935866', 'ff7bd203-71ce-4a8d-ae9b-7983f024f14a', 'f2c51c92-c562-49a1-b12e-8df600b8a939', 'd86877ca-61bd-4001-b510-13917e3bfc90'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b068c40-6be7-4fce-9785-f8473a9515df tempest-DeleteServersTestJSON-1906163439 None] Lock "cinder-88e25eea-4840-46ad-ae09-50cfc082d990-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:24 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:13:24 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:24 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.672s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:24 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Deleted volume successfully. Sep 28 12:13:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-faaed505-bd1a-4de4-8b8d-7060c140d43f tempest-VolumesNegativeTest-1239500328 None] Lock "cinder-230efe03-b587-4823-a535-91ec6ccde38f-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Acquiring lock "cinder-c80422f5-2f81-4918-8169-a2b169c15342-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "cinder-c80422f5-2f81-4918-8169-a2b169c15342-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Acquiring lock "cinder-quobyte-c80422f5-2f81-4918-8169-a2b169c15342" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "cinder-quobyte-c80422f5-2f81-4918-8169-a2b169c15342" acquired by "delete_volume" :: waited 0.043s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f475ed-3aba-4d71-9678-f8947dba2531]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:29 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 Sep 28 12:13:29 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:29 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342" returned: 0 in 1.013s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:30 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342 Sep 28 12:13:30 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:30 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c80422f5-2f81-4918-8169-a2b169c15342" returned: 0 in 0.797s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "cinder-quobyte-c80422f5-2f81-4918-8169-a2b169c15342" released by "delete_volume" :: held 1.951s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Created reservations ['f3ee6bf0-22a8-48a1-9f98-18bf2b672e5e', '35db99d7-b2fa-4f51-929d-52a2482d94c0', '4bea3495-1c69-4976-89f8-087fbd162c43', '1c0bda6f-18a5-4d13-bd7e-6e529970ffa5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Flow 'volume_create_manager' (26103233-d506-4c2f-8f6f-a2c6e8df5492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b0e0c1-4fe2-48ef-ae8f-c975b9e0f467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b0e0c1-4fe2-48ef-ae8f-c975b9e0f467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-451411699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303f0ddb-8514-4210-be3b-4c31561eb091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ea82ce38a143b5b7f74dd3935b3668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:31Z,use_quota=True,user_id='b44b86d405bb4694a2ff65eeb4b31bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f027f46-2d8f-43a2-9dd3-e72899d4f692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f027f46-2d8f-43a2-9dd3-e72899d4f692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bade271-b7d3-46c5-8453-3153383773df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bade271-b7d3-46c5-8453-3153383773df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303f0ddb-8514-4210-be3b-4c31561eb091', 'volume_name': 'volume-303f0ddb-8514-4210-be3b-4c31561eb091', 'volume_size': 2}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6334c045-722d-46e4-b95e-d7f557ca8be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6334c045-722d-46e4-b95e-d7f557ca8be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa10e2b-e4f5-47da-8f1a-45f9aa76df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Volume 303f0ddb-8514-4210-be3b-4c31561eb091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303f0ddb-8514-4210-be3b-4c31561eb091', 'volume_size': 2} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-451411699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303f0ddb-8514-4210-be3b-4c31561eb091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ea82ce38a143b5b7f74dd3935b3668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:31Z,use_quota=True,user_id='b44b86d405bb4694a2ff65eeb4b31bd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Creating volume 303f0ddb-8514-4210-be3b-4c31561eb091 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:13:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 2147483648 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:31 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 2147483648 Sep 28 12:13:31 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:31 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:13:31 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:31 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.532s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:31 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Deleted volume successfully. Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1b4a03bd-9920-4b5e-9e50-f0c186c03521 tempest-ServerRescueNegativeTestJSON-190303626 None] Lock "cinder-c80422f5-2f81-4918-8169-a2b169c15342-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:32 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 2147483648" returned: 0 in 0.976s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:32 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 Sep 28 12:13:32 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:32 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091" returned: 0 in 0.473s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa10e2b-e4f5-47da-8f1a-45f9aa76df4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303f0ddb-8514-4210-be3b-4c31561eb091', 'volume_size': 2}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c294765-e8f4-44e0-9022-91219c8828ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Volume volume-303f0ddb-8514-4210-be3b-4c31561eb091 (303f0ddb-8514-4210-be3b-4c31561eb091): created successfully Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c294765-e8f4-44e0-9022-91219c8828ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Flow 'volume_create_manager' (26103233-d506-4c2f-8f6f-a2c6e8df5492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f43d2ad9-9fcb-42f1-9fe9-a60fb5036bff tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Created volume successfully. Sep 28 12:13:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Creating offline snapshot 613ef60e-f1d6-4f4f-9e6a-8bee35561a06 of volume 303f0ddb-8514-4210-be3b-4c31561eb091 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:13:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c48cc-8122-4cb8-9a90-2ca3474e29c0]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:33 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 Sep 28 12:13:33 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:34 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 2G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:34 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 2G Sep 28 12:13:34 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:35 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 2G" returned: 0 in 0.668s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-303f0ddb-8514-4210-be3b-4c31561eb091 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:35 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-303f0ddb-8514-4210-be3b-4c31561eb091 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 Sep 28 12:13:35 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:35 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-303f0ddb-8514-4210-be3b-4c31561eb091 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06" returned: 0 in 0.481s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:35 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 is being set with open permissions: ugo+rw Sep 28 12:13:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:35 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 Sep 28 12:13:35 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:36 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06" returned: 0 in 0.427s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:36 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.info Sep 28 12:13:36 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:36 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.info" returned: 0 in 0.325s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:36 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.info is being set with open permissions: ugo+rw Sep 28 12:13:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:36 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.info Sep 28 12:13:36 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:36 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.info" returned: 0 in 0.296s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-631fd947-a4e0-4996-a245-9aa374c45492 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Create snapshot completed successfully Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "cinder-613ef60e-f1d6-4f4f-9e6a-8bee35561a06-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-613ef60e-f1d6-4f4f-9e6a-8bee35561a06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "cinder-quobyte-303f0ddb-8514-4210-be3b-4c31561eb091" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-quobyte-303f0ddb-8514-4210-be3b-4c31561eb091" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "cinder-quobyte-613ef60e-f1d6-4f4f-9e6a-8bee35561a06" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-quobyte-613ef60e-f1d6-4f4f-9e6a-8bee35561a06" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Deleting offline snapshot 613ef60e-f1d6-4f4f-9e6a-8bee35561a06 of volume 303f0ddb-8514-4210-be3b-4c31561eb091 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] snapshot_file for this snap is: volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[202c2458-621e-4ee9-b93b-9fb0b10dbe12]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:37 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 Sep 28 12:13:37 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:37 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06" returned: 0 in 0.495s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-303f0ddb-8514-4210-be3b-4c31561eb091(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8272c9-0d78-4fb9-a4bb-aaaccf43e062]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:38 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 Sep 28 12:13:38 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:38 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091" returned: 0 in 0.569s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:38 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 Sep 28 12:13:38 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:38 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06" returned: 0 in 0.511s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:38 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06 Sep 28 12:13:38 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:39 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091.613ef60e-f1d6-4f4f-9e6a-8bee35561a06" returned: 0 in 0.421s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-quobyte-613ef60e-f1d6-4f4f-9e6a-8bee35561a06" released by "_delete_snapshot" :: held 2.254s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-quobyte-303f0ddb-8514-4210-be3b-4c31561eb091" released by "delete_snapshot" :: held 2.298s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Created reservations ['a4c8ebec-07cb-4988-a1db-2fa1d0cfb067', 'ab8ce529-2ec4-4648-be07-6da576e8a897', 'c319f27d-075b-40c6-8c65-af8fd63eb4d9', '76bb0c39-fd98-40a1-af6e-bf4924330aed'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Delete snapshot completed successfully. Sep 28 12:13:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-112595dc-ff8a-4f4f-91b6-2c8cefb7aab8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-613ef60e-f1d6-4f4f-9e6a-8bee35561a06-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "cinder-303f0ddb-8514-4210-be3b-4c31561eb091-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-303f0ddb-8514-4210-be3b-4c31561eb091-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "cinder-quobyte-303f0ddb-8514-4210-be3b-4c31561eb091" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-quobyte-303f0ddb-8514-4210-be3b-4c31561eb091" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38af00d-ae54-45ae-94b8-126ad8e68f69]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:40 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 Sep 28 12:13:40 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:40 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091" returned: 0 in 0.439s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:41 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091 Sep 28 12:13:41 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:41 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-303f0ddb-8514-4210-be3b-4c31561eb091" returned: 0 in 0.320s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-quobyte-303f0ddb-8514-4210-be3b-4c31561eb091" released by "delete_volume" :: held 0.847s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Created reservations ['d103ac59-5687-482f-87b3-2d547621f7f7', '0f0ee165-3e52-4556-8127-e5f75d830e64', '6021a7c2-9ab9-4e86-8382-66ed187f0035', '27598141-30f7-41cd-9401-5066d522af0c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:41 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:13:41 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:42 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.467s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:42 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Deleted volume successfully. Sep 28 12:13:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-229f668f-c3c5-41c8-87da-829496ad10e8 tempest-VolumesSnapshotNegativeTestJSON-142767964 None] Lock "cinder-303f0ddb-8514-4210-be3b-4c31561eb091-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:13:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:49 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:13:49 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:50 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.543s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:50 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:13:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:13:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:13:51 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=38,cinder:UPDATE=51,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:13:52 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=49,cinder:SELECT=48,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Acquiring lock "cinder-567ce613-d8f4-4d12-9d1b-24efaf4d7b82-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "cinder-567ce613-d8f4-4d12-9d1b-24efaf4d7b82-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Acquiring lock "cinder-quobyte-567ce613-d8f4-4d12-9d1b-24efaf4d7b82" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "cinder-quobyte-567ce613-d8f4-4d12-9d1b-24efaf4d7b82" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[467521cf-19ec-4b7b-be60-cbdd3feeafde]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:53 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 Sep 28 12:13:53 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:53 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82" returned: 0 in 0.482s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:53 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82 Sep 28 12:13:53 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:53 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-567ce613-d8f4-4d12-9d1b-24efaf4d7b82" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "cinder-quobyte-567ce613-d8f4-4d12-9d1b-24efaf4d7b82" released by "delete_volume" :: held 0.868s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Created reservations ['e5e440d4-13f0-43a1-8733-e23edc0a70d4', '9c55dfce-390c-401e-81e2-5add5e7bd3d2', '4e72b1e8-5245-49c2-bf10-219083ffd1c7', 'd44cc246-eff9-4420-af6f-e4e45906deba'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:54 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:13:54 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:54 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Deleted volume successfully. Sep 28 12:13:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ede4f10e-c663-4852-953c-5ccf7bbc136b tempest-AttachVolumeShelveTestJSON-1847278226 None] Lock "cinder-567ce613-d8f4-4d12-9d1b-24efaf4d7b82-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Flow 'volume_create_manager' (870a757b-b1da-41f6-832e-55074b82a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd91f977-016b-4db9-b69b-718c3b741b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd91f977-016b-4db9-b69b-718c3b741b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2078789816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0650cc1-c2b3-4858-84cc-6791c26d19ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e7759b86844497b810359ee3d32737c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:57Z,use_quota=True,user_id='56e4120984e54ebea6e1bf37dd80e663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30614c2e-7bb4-4396-af46-8481b464533b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30614c2e-7bb4-4396-af46-8481b464533b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673cd53b-3dfc-428c-8bce-14c968006781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673cd53b-3dfc-428c-8bce-14c968006781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0650cc1-c2b3-4858-84cc-6791c26d19ad', 'volume_name': 'volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614163f6-fcc0-4d28-977d-7777b35259c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614163f6-fcc0-4d28-977d-7777b35259c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a465482-680d-47ac-9205-5d68ddbc7ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Volume e0650cc1-c2b3-4858-84cc-6791c26d19ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad', 'volume_size': 1} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2078789816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0650cc1-c2b3-4858-84cc-6791c26d19ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e7759b86844497b810359ee3d32737c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:57Z,use_quota=True,user_id='56e4120984e54ebea6e1bf37dd80e663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Creating volume e0650cc1-c2b3-4858-84cc-6791c26d19ad {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:13:57 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:13:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:57 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad 1073741824 Sep 28 12:13:57 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:58 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad 1073741824" returned: 0 in 0.601s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:58 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad Sep 28 12:13:58 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:58 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad" returned: 0 in 0.270s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a465482-680d-47ac-9205-5d68ddbc7ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e0fdee-6358-4b2e-8577-c1760f4c6363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Volume volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad (e0650cc1-c2b3-4858-84cc-6791c26d19ad): created successfully Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e0fdee-6358-4b2e-8577-c1760f4c6363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Flow 'volume_create_manager' (870a757b-b1da-41f6-832e-55074b82a78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5750d31f-f0b7-4fad-975d-b12e69019b95 tempest-VolumesTestJSON-942336085 None] Created volume successfully. Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Flow 'volume_create_manager' (0f3c1a8f-6cf3-461c-8915-dfeba9ac2722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463f0d3e-8523-41e2-aabf-61f3c99f4145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463f0d3e-8523-41e2-aabf-61f3c99f4145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2057264576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c5c51-53f3-4be7-856f-d3c66d589413,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e7759b86844497b810359ee3d32737c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:00Z,use_quota=True,user_id='56e4120984e54ebea6e1bf37dd80e663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8f8450-1f32-4afc-ae8c-73128a3c4658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8f8450-1f32-4afc-ae8c-73128a3c4658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edcc559-1015-4ee6-a835-7afa1f5bae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edcc559-1015-4ee6-a835-7afa1f5bae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027c5c51-53f3-4be7-856f-d3c66d589413', 'volume_name': 'volume-027c5c51-53f3-4be7-856f-d3c66d589413', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902b03a8-7560-4578-86a9-130d256cd031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902b03a8-7560-4578-86a9-130d256cd031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8040189-ae44-4d55-a9b9-2b068a50f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Volume 027c5c51-53f3-4be7-856f-d3c66d589413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027c5c51-53f3-4be7-856f-d3c66d589413', 'volume_size': 1} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2057264576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c5c51-53f3-4be7-856f-d3c66d589413,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e7759b86844497b810359ee3d32737c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:00Z,use_quota=True,user_id='56e4120984e54ebea6e1bf37dd80e663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Creating volume 027c5c51-53f3-4be7-856f-d3c66d589413 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:00 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:14:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:00 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 1073741824 Sep 28 12:14:00 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:01 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 1073741824" returned: 0 in 0.709s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:01 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 Sep 28 12:14:01 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:01 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413" returned: 0 in 0.358s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8040189-ae44-4d55-a9b9-2b068a50f97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027c5c51-53f3-4be7-856f-d3c66d589413', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece179a9-7753-44fe-b817-89876731ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Volume volume-027c5c51-53f3-4be7-856f-d3c66d589413 (027c5c51-53f3-4be7-856f-d3c66d589413): created successfully Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece179a9-7753-44fe-b817-89876731ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Flow 'volume_create_manager' (0f3c1a8f-6cf3-461c-8915-dfeba9ac2722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9147c193-b318-4564-8657-02afd083a7f8 tempest-VolumesTestJSON-942336085 None] Created volume successfully. Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Flow 'volume_create_manager' (4b20192b-f1e1-4bf3-b071-29776ead3c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a610877c-1269-4291-b982-1cba45dc8093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a610877c-1269-4291-b982-1cba45dc8093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-564815751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6fe600-ff39-4ba9-b241-08de270bd2a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e7759b86844497b810359ee3d32737c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:03Z,use_quota=True,user_id='56e4120984e54ebea6e1bf37dd80e663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c630047c-f65b-44af-b77d-78481a5d5c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c630047c-f65b-44af-b77d-78481a5d5c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5db5ac-18ee-43d1-abc4-304994378e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5db5ac-18ee-43d1-abc4-304994378e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d6fe600-ff39-4ba9-b241-08de270bd2a0', 'volume_name': 'volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ffacda-503f-4227-b185-ad4a91c99bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ffacda-503f-4227-b185-ad4a91c99bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad996fb-4613-4caa-9dd0-705c48f6d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Volume 5d6fe600-ff39-4ba9-b241-08de270bd2a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0', 'volume_size': 1} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-564815751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6fe600-ff39-4ba9-b241-08de270bd2a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0e7759b86844497b810359ee3d32737c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:03Z,use_quota=True,user_id='56e4120984e54ebea6e1bf37dd80e663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Creating volume 5d6fe600-ff39-4ba9-b241-08de270bd2a0 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:03 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:14:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:03 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 1073741824 Sep 28 12:14:03 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:04 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 1073741824" returned: 0 in 0.750s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:04 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 Sep 28 12:14:04 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:04 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0" returned: 0 in 0.389s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad996fb-4613-4caa-9dd0-705c48f6d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e847bdcd-12ac-4084-891a-9bedd2910214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Volume volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 (5d6fe600-ff39-4ba9-b241-08de270bd2a0): created successfully Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e847bdcd-12ac-4084-891a-9bedd2910214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Flow 'volume_create_manager' (4b20192b-f1e1-4bf3-b071-29776ead3c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-397b1b42-cc52-4229-9192-d113d61e16f9 tempest-VolumesTestJSON-942336085 None] Created volume successfully. Sep 28 12:14:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Acquiring lock "cinder-5d6fe600-ff39-4ba9-b241-08de270bd2a0-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Lock "cinder-5d6fe600-ff39-4ba9-b241-08de270bd2a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Acquiring lock "cinder-quobyte-5d6fe600-ff39-4ba9-b241-08de270bd2a0" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Lock "cinder-quobyte-5d6fe600-ff39-4ba9-b241-08de270bd2a0" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de5cde-5f00-4998-ae0f-1229584cc8e9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:07 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 Sep 28 12:14:07 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:07 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0" returned: 0 in 0.515s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:07 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0 Sep 28 12:14:07 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:07 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5d6fe600-ff39-4ba9-b241-08de270bd2a0" returned: 0 in 0.345s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Lock "cinder-quobyte-5d6fe600-ff39-4ba9-b241-08de270bd2a0" released by "delete_volume" :: held 0.943s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Created reservations ['731082de-c970-4285-af88-351ea2dcf76d', '305ff24b-3573-46bb-9b4b-bff7837b2d38', 'fb83eea9-f559-4316-9f01-755dd56dede3', 'cf88a4d4-b3b5-4380-89cd-b26f037383e8'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:07 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:14:07 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:08 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:08 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Deleted volume successfully. Sep 28 12:14:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3f8ddd53-4b9d-4551-bcaa-8d5cf88e5929 tempest-VolumesTestJSON-942336085 None] Lock "cinder-5d6fe600-ff39-4ba9-b241-08de270bd2a0-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Acquiring lock "cinder-027c5c51-53f3-4be7-856f-d3c66d589413-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Lock "cinder-027c5c51-53f3-4be7-856f-d3c66d589413-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Acquiring lock "cinder-quobyte-027c5c51-53f3-4be7-856f-d3c66d589413" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Lock "cinder-quobyte-027c5c51-53f3-4be7-856f-d3c66d589413" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b43900-f00e-411d-b015-8cc97fd20657]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:09 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 Sep 28 12:14:09 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:09 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413" returned: 0 in 0.477s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:09 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413 Sep 28 12:14:09 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:10 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027c5c51-53f3-4be7-856f-d3c66d589413" returned: 0 in 0.412s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Lock "cinder-quobyte-027c5c51-53f3-4be7-856f-d3c66d589413" released by "delete_volume" :: held 0.940s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Created reservations ['f7966906-dd8d-4530-853f-2de0e318dd43', 'abbff8ef-0a53-4032-939b-cb0a43c79acc', 'd289a676-9ac1-4cd9-b5e6-d9a0c80d7e8c', 'd2cfb549-915b-40a9-8e87-a1b945618dae'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:10 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:14:10 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:10 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.284s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Deleted volume successfully. Sep 28 12:14:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-50ce1018-7d1a-471d-92e1-4840cb50fa88 tempest-VolumesTestJSON-942336085 None] Lock "cinder-027c5c51-53f3-4be7-856f-d3c66d589413-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Acquiring lock "cinder-e0650cc1-c2b3-4858-84cc-6791c26d19ad-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Lock "cinder-e0650cc1-c2b3-4858-84cc-6791c26d19ad-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Acquiring lock "cinder-quobyte-e0650cc1-c2b3-4858-84cc-6791c26d19ad" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Lock "cinder-quobyte-e0650cc1-c2b3-4858-84cc-6791c26d19ad" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aaad96-088f-4390-8c40-cfd20b22fb2c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:11 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad Sep 28 12:14:11 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:12 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad" returned: 0 in 0.578s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:12 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad Sep 28 12:14:12 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:12 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0650cc1-c2b3-4858-84cc-6791c26d19ad" returned: 0 in 0.322s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Lock "cinder-quobyte-e0650cc1-c2b3-4858-84cc-6791c26d19ad" released by "delete_volume" :: held 0.974s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Created reservations ['656b5ce7-bd6b-465c-b8be-fd09b4b5f165', 'ac4f54e0-b1a6-4d81-abeb-f6fdc3bfcc1f', '8b4d22c1-c829-4765-a736-bfe525da974b', '15f706e6-4173-4618-86cb-e5ae45d82fdc'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:12 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:14:12 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:12 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.282s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:12 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Deleted volume successfully. Sep 28 12:14:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-861af0fe-3770-46fe-8460-bda8e271506d tempest-VolumesTestJSON-942336085 None] Lock "cinder-e0650cc1-c2b3-4858-84cc-6791c26d19ad-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:22 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:14:22 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=27,cinder:UPDATE=43,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:14:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-10bbc2ab-296c-4228-9e44-fabf65020fd2 tempest-GroupSnapshotsTest-1516001785 None] Group tempest-GroupSnapshotsTest-Group-638352057: creating Sep 28 12:14:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-10bbc2ab-296c-4228-9e44-fabf65020fd2 tempest-GroupSnapshotsTest-1516001785 None] Group tempest-GroupSnapshotsTest-Group-638352057: created successfully Sep 28 12:14:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-10bbc2ab-296c-4228-9e44-fabf65020fd2 tempest-GroupSnapshotsTest-1516001785 None] Create group completed successfully. Sep 28 12:14:35 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Flow 'volume_create_manager' (92f9d6dc-6379-4d6d-a667-87f5eea52503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1251956-956d-4651-8677-ba0b1a20370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1251956-956d-4651-8677-ba0b1a20370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-421314843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be5d3900-3462-4fd9-82ee-37956150a407,host='devstack@QuobyteHD#QuobyteHD',id=0389b70b-f558-48fb-a58c-b44cfef4a6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74da342ba497482fac265a84b19b675c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:36Z,use_quota=True,user_id='fe4c0f8027b840ce8f8e2fb0ba3155c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37eb8499-18e8-43f9-a40e-19d0b3548808),volume_type_id=37eb8499-18e8-43f9-a40e-19d0b3548808)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6eab9f-6323-4079-bb83-9e35f03f2155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6eab9f-6323-4079-bb83-9e35f03f2155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123c3e80-304e-4d0c-b076-648555f3514a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123c3e80-304e-4d0c-b076-648555f3514a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0389b70b-f558-48fb-a58c-b44cfef4a6d1', 'volume_name': 'volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b5c7db-5775-49e2-a3c1-09718422c1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b5c7db-5775-49e2-a3c1-09718422c1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a712a4c7-ec89-4a1e-bd03-b316de870e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:36 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Volume 0389b70b-f558-48fb-a58c-b44cfef4a6d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1', 'volume_size': 1} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be5d3900-3462-4fd9-82ee-37956150a407,created_at=2026-09-28T10:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-421314843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be5d3900-3462-4fd9-82ee-37956150a407,host='devstack@QuobyteHD#QuobyteHD',id=0389b70b-f558-48fb-a58c-b44cfef4a6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74da342ba497482fac265a84b19b675c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:36Z,use_quota=True,user_id='fe4c0f8027b840ce8f8e2fb0ba3155c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37eb8499-18e8-43f9-a40e-19d0b3548808),volume_type_id=37eb8499-18e8-43f9-a40e-19d0b3548808)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Creating volume 0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:36 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:14:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:36 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 1073741824 Sep 28 12:14:36 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:37 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 1073741824" returned: 0 in 1.148s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:37 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 Sep 28 12:14:37 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:37 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1" returned: 0 in 0.536s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a712a4c7-ec89-4a1e-bd03-b316de870e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d800506d-d514-4748-b2c9-cb1efd8e3699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:37 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Volume volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 (0389b70b-f558-48fb-a58c-b44cfef4a6d1): created successfully Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d800506d-d514-4748-b2c9-cb1efd8e3699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Flow 'volume_create_manager' (92f9d6dc-6379-4d6d-a667-87f5eea52503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-78065f4d-87ef-4d35-aaa0-dbf2a35e47fa tempest-GroupSnapshotsTest-1516001785 None] Created volume successfully. Sep 28 12:14:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] GroupSnapshot 5662ffbd-f43c-4330-91dc-a29bd32b9b5a: creating. Sep 28 12:14:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Group snapshot 5662ffbd-f43c-4330-91dc-a29bd32b9b5a: creating. {{(pid=87167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 12:14:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Creating offline snapshot 43c00baf-d3fc-42a5-907a-94aad58aabe6 of volume 0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:14:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00b92e8-73ac-4b8b-9c2a-91a2c9fd2d30]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:39 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 Sep 28 12:14:39 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:39 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1" returned: 0 in 0.532s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:39 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 1G Sep 28 12:14:39 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:40 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 1G" returned: 0 in 0.735s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:40 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 Sep 28 12:14:40 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:41 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6" returned: 0 in 0.375s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:41 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:14:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:41 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 Sep 28 12:14:41 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:41 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6" returned: 0 in 0.545s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:41 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.info Sep 28 12:14:41 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:42 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.info" returned: 0 in 0.563s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:42 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:14:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:42 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.info Sep 28 12:14:42 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:42 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.info" returned: 0 in 0.491s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.393s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2e6d8f4d-6c52-4d4f-b9a6-b03277ecd071 tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 5662ffbd-f43c-4330-91dc-a29bd32b9b5a: created successfully Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-43c00baf-d3fc-42a5-907a-94aad58aabe6-915fe537-e86d-4f47-8ed0-10dff65a68e5" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-43c00baf-d3fc-42a5-907a-94aad58aabe6-915fe537-e86d-4f47-8ed0-10dff65a68e5" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Creating volume 915fe537-e86d-4f47-8ed0-10dff65a68e5 from snapshot 43c00baf-d3fc-42a5-907a-94aad58aabe6 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-915fe537-e86d-4f47-8ed0-10dff65a68e5" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-915fe537-e86d-4f47-8ed0-10dff65a68e5" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] snapshot: 43c00baf-d3fc-42a5-907a-94aad58aabe6, volume: 915fe537-e86d-4f47-8ed0-10dff65a68e5, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e403d6-63da-418e-96d6-c1cdeb5845b6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:45 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 Sep 28 12:14:45 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:46 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6" returned: 0 in 0.663s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9929910d-9361-485f-9775-5bebb78a4341]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:46 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 Sep 28 12:14:46 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:46 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1" returned: 0 in 0.413s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:14:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:46 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 Sep 28 12:14:46 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:14:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:49 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:14:49 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:50 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 1.424s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:50 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:14:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:14:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Flow 'volume_create_manager' (6d454c29-59d9-4ca4-8e9d-ecabfcdd4521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64023a43-ec2d-41a7-af86-5eb610df9dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64023a43-ec2d-41a7-af86-5eb610df9dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2075081647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb031878-aad3-468e-8ec9-56bade96dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922f99415e2241e797224a121518c465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:52Z,use_quota=True,user_id='c6de6994af774f2690503de9f8dee63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b523ecb6-558a-4a9c-9e89-fd15a313471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b523ecb6-558a-4a9c-9e89-fd15a313471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15b6743-df1d-4ee4-b857-0a3ad22160b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15b6743-df1d-4ee4-b857-0a3ad22160b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb031878-aad3-468e-8ec9-56bade96dbf4', 'volume_name': 'volume-bb031878-aad3-468e-8ec9-56bade96dbf4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44179d32-b8ad-4398-b386-e08b70f6c5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44179d32-b8ad-4398-b386-e08b70f6c5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4041f5fd-6d50-4185-97d4-2ffd0ff764bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:52 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Volume bb031878-aad3-468e-8ec9-56bade96dbf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb031878-aad3-468e-8ec9-56bade96dbf4', 'volume_size': 1} Sep 28 12:14:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:57 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5" returned: 0 in 10.616s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1, size 1024.00 MB, duration 10.62 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:14:57 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Converted 1024.00 MB image at 96.45 MB/s Sep 28 12:14:57 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:57 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 Sep 28 12:14:57 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:57 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5" returned: 0 in 0.284s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-915fe537-e86d-4f47-8ed0-10dff65a68e5" released by "_copy_volume_from_snapshot" :: held 12.172s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-43c00baf-d3fc-42a5-907a-94aad58aabe6-915fe537-e86d-4f47-8ed0-10dff65a68e5" released by "_create_volume_from_snapshot" :: held 12.320s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.373s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.961s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2075081647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb031878-aad3-468e-8ec9-56bade96dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922f99415e2241e797224a121518c465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:52Z,use_quota=True,user_id='c6de6994af774f2690503de9f8dee63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Creating volume bb031878-aad3-468e-8ec9-56bade96dbf4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:57 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:14:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:57 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 1073741824 Sep 28 12:14:57 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2bffb19-508f-413f-8953-4b81c4d79230 tempest-GroupSnapshotsTest-1516001785 None] Create group from source-snapshot-5662ffbd-f43c-4330-91dc-a29bd32b9b5a completed successfully. Sep 28 12:14:58 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 1073741824" returned: 0 in 0.561s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:58 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 Sep 28 12:14:58 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:58 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4" returned: 0 in 0.269s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4041f5fd-6d50-4185-97d4-2ffd0ff764bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb031878-aad3-468e-8ec9-56bade96dbf4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3438313a-f592-4029-a8f9-b0f192c967ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Volume volume-bb031878-aad3-468e-8ec9-56bade96dbf4 (bb031878-aad3-468e-8ec9-56bade96dbf4): created successfully Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3438313a-f592-4029-a8f9-b0f192c967ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Flow 'volume_create_manager' (6d454c29-59d9-4ca4-8e9d-ecabfcdd4521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a70f3f52-967c-4f80-8d3a-30af4b4c0a49 tempest-ServerActionsTestOtherA-175313115 None] Created volume successfully. Sep 28 12:14:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-915fe537-e86d-4f47-8ed0-10dff65a68e5" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-915fe537-e86d-4f47-8ed0-10dff65a68e5" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e84cd9-0415-40f9-8119-6790ac147d6d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:59 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 Sep 28 12:14:59 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:00 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5" returned: 0 in 0.651s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:00 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5 Sep 28 12:15:00 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:00 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-915fe537-e86d-4f47-8ed0-10dff65a68e5" returned: 0 in 0.371s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-915fe537-e86d-4f47-8ed0-10dff65a68e5" released by "delete_volume" :: held 1.112s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:00 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['50bc5407-3bca-4d0f-99fc-3354fa608051'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:00 devstack cinder-volume[87167]: WARNING cinder.quota [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1586538579 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1586538579, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:00 devstack cinder-volume[87167]: WARNING cinder.quota [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1586538579 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1586538579, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:00 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['4a6a6f0b-e61f-4330-9406-8c8e065458ca', '2c81fb81-8bfe-431f-b098-e536b7a93b41', '052c84e4-4071-4e96-b31b-cb98875c5524', 'eaa1aacf-be09-4ec3-87f2-eb8981869ccd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:01 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:15:01 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 5662ffbd-f43c-4330-91dc-a29bd32b9b5a: deleting Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 5662ffbd-f43c-4330-91dc-a29bd32b9b5a: deleting {{(pid=87167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-0389b70b-f558-48fb-a58c-b44cfef4a6d1" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-0389b70b-f558-48fb-a58c-b44cfef4a6d1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-43c00baf-d3fc-42a5-907a-94aad58aabe6" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-43c00baf-d3fc-42a5-907a-94aad58aabe6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Deleting offline snapshot 43c00baf-d3fc-42a5-907a-94aad58aabe6 of volume 0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] snapshot_file for this snap is: volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1886f9-097f-40c4-b23d-4212e63f97e8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:01 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.530s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:01 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-07c278ea-2971-40ba-9ed5-d3b588091440 tempest-GroupSnapshotsTest-1516001785 None] Delete group completed successfully. Sep 28 12:15:01 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 Sep 28 12:15:01 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:02 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6" returned: 0 in 0.501s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:15:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985bb61-3a7a-4b09-9034-a9ba0531c5b7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:02 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 Sep 28 12:15:02 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:02 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:02 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 Sep 28 12:15:02 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:03 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6" returned: 0 in 0.427s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:03 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6 Sep 28 12:15:03 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:03 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1.43c00baf-d3fc-42a5-907a-94aad58aabe6" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-43c00baf-d3fc-42a5-907a-94aad58aabe6" released by "_delete_snapshot" :: held 2.112s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-0389b70b-f558-48fb-a58c-b44cfef4a6d1" released by "delete_snapshot" :: held 2.148s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:03 devstack cinder-volume[87167]: WARNING cinder.quota [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1586538579 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1586538579, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['b3227d4d-a988-41b8-9089-eb4edd00c7e4', '2ed2608b-a3f3-449d-b921-ed17d602e0be', 'b02d5df2-0a9d-4ace-81a2-62b4ed1f1765', 'b5f3f77f-1821-40fe-abbc-be03c0f54c44'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-653cc357-a03b-4e01-9488-6c76e39d3b1a tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 5662ffbd-f43c-4330-91dc-a29bd32b9b5a: deleted successfully Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Flow 'volume_create_manager' (0932772b-272d-43a7-92bd-f977a3a4eca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4ad445-9db3-4cf8-b081-62f3b9af633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4ad445-9db3-4cf8-b081-62f3b9af633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-483788498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5541bc13-b5fe-4435-96b8-64fc9614767e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfb5bcc4e30402a9ea098e828c64ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:04Z,use_quota=True,user_id='9670c520b48f4306a153738ba60be13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88de0832-b9e0-41a4-88c5-3a1f3aa3dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88de0832-b9e0-41a4-88c5-3a1f3aa3dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36adf2d-6a46-48b3-924b-7252f97c961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36adf2d-6a46-48b3-924b-7252f97c961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5541bc13-b5fe-4435-96b8-64fc9614767e', 'volume_name': 'volume-5541bc13-b5fe-4435-96b8-64fc9614767e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203d3e99-a9ac-452d-a733-7d600c225d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203d3e99-a9ac-452d-a733-7d600c225d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbae744-8e85-4734-9eb6-b5cc53449687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Volume 5541bc13-b5fe-4435-96b8-64fc9614767e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5541bc13-b5fe-4435-96b8-64fc9614767e', 'volume_size': 1} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-483788498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5541bc13-b5fe-4435-96b8-64fc9614767e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfb5bcc4e30402a9ea098e828c64ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:04Z,use_quota=True,user_id='9670c520b48f4306a153738ba60be13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Creating volume 5541bc13-b5fe-4435-96b8-64fc9614767e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:15:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:04 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e 1073741824 Sep 28 12:15:04 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:04 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e 1073741824" returned: 0 in 0.534s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:04 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e Sep 28 12:15:04 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:05 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e" returned: 0 in 0.439s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbae744-8e85-4734-9eb6-b5cc53449687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5541bc13-b5fe-4435-96b8-64fc9614767e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c239f4e-58bf-4803-8b51-c220f9a5c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Volume volume-5541bc13-b5fe-4435-96b8-64fc9614767e (5541bc13-b5fe-4435-96b8-64fc9614767e): created successfully Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c239f4e-58bf-4803-8b51-c220f9a5c502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Flow 'volume_create_manager' (0932772b-272d-43a7-92bd-f977a3a4eca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4c962a3d-21ab-4b78-b34d-13a99516f80b tempest-AttachVolumeTestJSON-309856177 None] Created volume successfully. Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-0389b70b-f558-48fb-a58c-b44cfef4a6d1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-0389b70b-f558-48fb-a58c-b44cfef4a6d1" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[114f077b-3879-4d46-b00d-559438f68323]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:05 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 Sep 28 12:15:05 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:05 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1" returned: 0 in 0.507s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:05 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1 Sep 28 12:15:05 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:06 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0389b70b-f558-48fb-a58c-b44cfef4a6d1" returned: 0 in 0.312s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-0389b70b-f558-48fb-a58c-b44cfef4a6d1" released by "delete_volume" :: held 0.927s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['7a0be7b9-d71b-4c4c-a331-8a1c946f291c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:06 devstack cinder-volume[87167]: WARNING cinder.db.api [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1586538579'] Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['7f39fe83-a2ac-4c5c-b9eb-10c67b5bd90c', '90e2f2b7-f8fd-4006-815a-580c7010cf63', '8c6393bf-d235-468b-916f-be37121d3cee', '585a1c0d-70ae-42e8-a5d9-81837022ef37'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:06 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:15:06 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:07 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.562s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:07 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4966ef25-c324-4e0b-a960-81a2fc28f2ec tempest-GroupSnapshotsTest-1516001785 None] Delete group completed successfully. Sep 28 12:15:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-9d1fd8be-70c6-4770-a124-fa7211e3e269 req-f0ff839e-85f2-43b2-b52e-5f893e75aca0 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-9d1fd8be-70c6-4770-a124-fa7211e3e269 req-f0ff839e-85f2-43b2-b52e-5f893e75aca0 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-9d1fd8be-70c6-4770-a124-fa7211e3e269 req-f0ff839e-85f2-43b2-b52e-5f893e75aca0 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-9d1fd8be-70c6-4770-a124-fa7211e3e269 req-f0ff839e-85f2-43b2-b52e-5f893e75aca0 tempest-AttachVolumeTestJSON-309856177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-5541bc13-b5fe-4435-96b8-64fc9614767e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdcf14d4-7429-450c-b5e4-8304e8724a63', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:15:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-9d1fd8be-70c6-4770-a124-fa7211e3e269 req-f0ff839e-85f2-43b2-b52e-5f893e75aca0 tempest-AttachVolumeTestJSON-309856177 None] attachment_update completed successfully. Sep 28 12:15:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7fcebfdc-f86d-4eb9-b22c-5d76377df60d tempest-GroupSnapshotsTest-1516001785 None] Group tempest-GroupSnapshotsTest-Group-1707215438: creating Sep 28 12:15:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7fcebfdc-f86d-4eb9-b22c-5d76377df60d tempest-GroupSnapshotsTest-1516001785 None] Group tempest-GroupSnapshotsTest-Group-1707215438: created successfully Sep 28 12:15:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7fcebfdc-f86d-4eb9-b22c-5d76377df60d tempest-GroupSnapshotsTest-1516001785 None] Create group completed successfully. Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Flow 'volume_create_manager' (96b0beaf-0eea-479e-9b41-5442039e7ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571292b7-b8a3-436b-97ec-e5778dcc27d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571292b7-b8a3-436b-97ec-e5778dcc27d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1583397225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a28632be-6f97-44ca-8bdd-8c218955ac2d,host='devstack@QuobyteHD#QuobyteHD',id=6e77c081-4294-44de-a386-f78ea25b2a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74da342ba497482fac265a84b19b675c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:09Z,use_quota=True,user_id='fe4c0f8027b840ce8f8e2fb0ba3155c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac738623-1a97-4371-b53b-2f19c3824238),volume_type_id=ac738623-1a97-4371-b53b-2f19c3824238)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c612a5-d35e-472c-9988-d48eae01bba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c612a5-d35e-472c-9988-d48eae01bba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be67030e-7c15-4fb2-9602-611344a1eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be67030e-7c15-4fb2-9602-611344a1eba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e77c081-4294-44de-a386-f78ea25b2a92', 'volume_name': 'volume-6e77c081-4294-44de-a386-f78ea25b2a92', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e0d7e0-e29c-4335-8446-d57d76cad3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e0d7e0-e29c-4335-8446-d57d76cad3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311057ba-9051-4d51-a8b7-aa48297c4606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Volume 6e77c081-4294-44de-a386-f78ea25b2a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e77c081-4294-44de-a386-f78ea25b2a92', 'volume_size': 1} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a28632be-6f97-44ca-8bdd-8c218955ac2d,created_at=2026-09-28T10:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1583397225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a28632be-6f97-44ca-8bdd-8c218955ac2d,host='devstack@QuobyteHD#QuobyteHD',id=6e77c081-4294-44de-a386-f78ea25b2a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74da342ba497482fac265a84b19b675c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:09Z,use_quota=True,user_id='fe4c0f8027b840ce8f8e2fb0ba3155c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac738623-1a97-4371-b53b-2f19c3824238),volume_type_id=ac738623-1a97-4371-b53b-2f19c3824238)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Creating volume 6e77c081-4294-44de-a386-f78ea25b2a92 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:09 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:15:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:09 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 1073741824 Sep 28 12:15:09 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:10 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 1073741824" returned: 0 in 0.812s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:10 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 Sep 28 12:15:10 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:11 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92" returned: 0 in 0.425s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311057ba-9051-4d51-a8b7-aa48297c4606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e77c081-4294-44de-a386-f78ea25b2a92', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b458cb4-031d-4071-97a4-a7b5b97c6c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Volume volume-6e77c081-4294-44de-a386-f78ea25b2a92 (6e77c081-4294-44de-a386-f78ea25b2a92): created successfully Sep 28 12:15:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b458cb4-031d-4071-97a4-a7b5b97c6c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Flow 'volume_create_manager' (96b0beaf-0eea-479e-9b41-5442039e7ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-deed7467-aea8-412b-a95d-84ff5da1f489 tempest-GroupSnapshotsTest-1516001785 None] Created volume successfully. Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Flow 'volume_create_manager' (1ac002ad-a4c0-41c3-8daa-9f79ad52cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2166c0e-d512-4636-9009-bd6a4c0e9fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2166c0e-d512-4636-9009-bd6a4c0e9fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-110376362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a28632be-6f97-44ca-8bdd-8c218955ac2d,host='devstack@QuobyteHD#QuobyteHD',id=a82bd6ac-f323-4406-8f65-b089fe156d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74da342ba497482fac265a84b19b675c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:13Z,use_quota=True,user_id='fe4c0f8027b840ce8f8e2fb0ba3155c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac738623-1a97-4371-b53b-2f19c3824238),volume_type_id=ac738623-1a97-4371-b53b-2f19c3824238)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35498e1-c9c0-4fb2-8a40-0f8c1ba378ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35498e1-c9c0-4fb2-8a40-0f8c1ba378ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfda978-e433-4581-89ba-e21324894efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfda978-e433-4581-89ba-e21324894efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82bd6ac-f323-4406-8f65-b089fe156d0b', 'volume_name': 'volume-a82bd6ac-f323-4406-8f65-b089fe156d0b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fb9c97-f686-4a81-b1f2-778d22bc4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fb9c97-f686-4a81-b1f2-778d22bc4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc61d0e8-22ce-4f3a-8a78-6e6f20943c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Volume a82bd6ac-f323-4406-8f65-b089fe156d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82bd6ac-f323-4406-8f65-b089fe156d0b', 'volume_size': 1} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a28632be-6f97-44ca-8bdd-8c218955ac2d,created_at=2026-09-28T10:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-110376362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a28632be-6f97-44ca-8bdd-8c218955ac2d,host='devstack@QuobyteHD#QuobyteHD',id=a82bd6ac-f323-4406-8f65-b089fe156d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74da342ba497482fac265a84b19b675c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:13Z,use_quota=True,user_id='fe4c0f8027b840ce8f8e2fb0ba3155c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac738623-1a97-4371-b53b-2f19c3824238),volume_type_id=ac738623-1a97-4371-b53b-2f19c3824238)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Creating volume a82bd6ac-f323-4406-8f65-b089fe156d0b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:13 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:15:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:13 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b 1073741824 Sep 28 12:15:13 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Flow 'volume_create_manager' (e5ba4385-4348-4406-a6ef-9db9ec670e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b496de68-0343-4f27-9402-07f79ee05752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b496de68-0343-4f27-9402-07f79ee05752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1393738688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b105bc9e1be04df8abce2783cc5f6631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:14Z,use_quota=True,user_id='0b12fbd130e64e99925acc3ad6bd0ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ca013a-e3d3-4dc7-8f79-3a260c8d96a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:14 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ca013a-e3d3-4dc7-8f79-3a260c8d96a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ca0599-3397-4336-b88f-0583b2529ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ca0599-3397-4336-b88f-0583b2529ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a', 'volume_name': 'volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8df46f-a0a4-4b1f-983b-a24d3a2483d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8df46f-a0a4-4b1f-983b-a24d3a2483d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a921813c-f3b2-4b7c-bd4b-0187e176531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Volume a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a', 'volume_size': 1} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b 1073741824" returned: 0 in 0.999s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:14 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b Sep 28 12:15:14 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:15 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1393738688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b105bc9e1be04df8abce2783cc5f6631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:14Z,use_quota=True,user_id='0b12fbd130e64e99925acc3ad6bd0ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Creating volume a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:15 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:15 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a 1073741824 Sep 28 12:15:15 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc61d0e8-22ce-4f3a-8a78-6e6f20943c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82bd6ac-f323-4406-8f65-b089fe156d0b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cc517c-c70b-4638-8ad1-d76f098b21e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Volume volume-a82bd6ac-f323-4406-8f65-b089fe156d0b (a82bd6ac-f323-4406-8f65-b089fe156d0b): created successfully Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cc517c-c70b-4638-8ad1-d76f098b21e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Flow 'volume_create_manager' (1ac002ad-a4c0-41c3-8daa-9f79ad52cac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c63cea14-d81d-4173-abfa-25e2ca0ba04f tempest-GroupSnapshotsTest-1516001785 None] Created volume successfully. Sep 28 12:15:15 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a 1073741824" returned: 0 in 0.804s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:15 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a Sep 28 12:15:15 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:16 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a" returned: 0 in 0.777s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a921813c-f3b2-4b7c-bd4b-0187e176531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2827f28d-6dc6-49bb-ac81-5938626d1ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Volume volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a (a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a): created successfully Sep 28 12:15:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2827f28d-6dc6-49bb-ac81-5938626d1ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Flow 'volume_create_manager' (e5ba4385-4348-4406-a6ef-9db9ec670e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-051e6076-85d2-47c5-94dd-b2fbea8bcf2f tempest-GroupSnapshotsTest-1516001785 None] Update group completed successfully. Sep 28 12:15:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5e383321-2e4d-478b-8a9a-5582363f8b30 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Created volume successfully. Sep 28 12:15:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3cd8a350-8639-45f5-8d62-136db28330aa tempest-GroupSnapshotsTest-1516001785 None] Update group completed successfully. Sep 28 12:15:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-21a19d5a-3c62-4328-ab99-050dc7d9b167 req-1b12d8c8-9d7c-4435-82b9-67d120c035cd tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-21a19d5a-3c62-4328-ab99-050dc7d9b167 req-1b12d8c8-9d7c-4435-82b9-67d120c035cd tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-21a19d5a-3c62-4328-ab99-050dc7d9b167 req-1b12d8c8-9d7c-4435-82b9-67d120c035cd tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-21a19d5a-3c62-4328-ab99-050dc7d9b167 req-1b12d8c8-9d7c-4435-82b9-67d120c035cd tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2492130-fab6-4803-81a0-0d82ab990d92', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:15:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-21a19d5a-3c62-4328-ab99-050dc7d9b167 req-1b12d8c8-9d7c-4435-82b9-67d120c035cd tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] attachment_update completed successfully. Sep 28 12:15:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-80a5f431-e4a0-45c4-af82-20a46c806fb5 tempest-GroupSnapshotsTest-1516001785 None] Update group completed successfully. Sep 28 12:15:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-90729c88-7ab0-4752-9e61-89515a9696e4 tempest-GroupSnapshotsTest-1516001785 None] Update group completed successfully. Sep 28 12:15:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] GroupSnapshot 2da191a0-0ddb-40d5-9aa2-9745ad0e44e6: creating. Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Group snapshot 2da191a0-0ddb-40d5-9aa2-9745ad0e44e6: creating. {{(pid=87167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Creating offline snapshot 17592374-032c-4bc1-804d-8a622224a8a8 of volume a82bd6ac-f323-4406-8f65-b089fe156d0b {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c04d9b-b56c-4952-bc3d-8ce90add22c6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:22 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b Sep 28 12:15:22 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:22 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b" returned: 0 in 0.437s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:22 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 1G Sep 28 12:15:22 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-62df23dc-8d29-46ad-a88a-40cd7f80ecd9 req-780061f1-d6f5-442c-a569-56ac486c7839 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Terminate volume connection completed successfully. Sep 28 12:15:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-62df23dc-8d29-46ad-a88a-40cd7f80ecd9 req-780061f1-d6f5-442c-a569-56ac486c7839 tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Deleting attachment f2492130-fab6-4803-81a0-0d82ab990d92. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:15:23 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 1G" returned: 0 in 0.496s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82bd6ac-f323-4406-8f65-b089fe156d0b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:23 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82bd6ac-f323-4406-8f65-b089fe156d0b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 Sep 28 12:15:23 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:23 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82bd6ac-f323-4406-8f65-b089fe156d0b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8" returned: 0 in 0.331s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:23 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:23 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 Sep 28 12:15:23 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Acquiring lock "cinder-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "cinder-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Acquiring lock "cinder-quobyte-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "cinder-quobyte-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[87608d1a-67af-4d1a-b5b4-be544dc690ea]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:23 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:23 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.info Sep 28 12:15:23 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:23 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a Sep 28 12:15:23 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:23 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.info" returned: 0 in 0.269s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:23 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:23 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.info Sep 28 12:15:23 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:24 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a" returned: 0 in 0.416s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:24 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a Sep 28 12:15:24 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:24 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.info" returned: 0 in 0.271s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Creating offline snapshot 2667f0d7-a276-45be-8900-21dd76902da9 of volume 6e77c081-4294-44de-a386-f78ea25b2a92 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c91412a-f6a2-4f58-9bf1-63096552d392]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:24 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "cinder-quobyte-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a" released by "delete_volume" :: held 0.764s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Created reservations ['5da0d34a-1af4-4bbd-8d3b-501005d7456a', 'b389ece0-c165-441c-b91d-8510459bd431', '48ff7a3a-df7a-4c43-ba46-465239126664', '02445a87-3473-46a8-bd9c-cedcf91a2aa2'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:24 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 Sep 28 12:15:24 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:24 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:15:24 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:24 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.287s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:24 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Deleted volume successfully. Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92" returned: 0 in 0.459s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1682e49d-1911-4c2a-bf14-7628cbce88ce tempest-TestServerVolumeAttachScenarioOldVersion-1816686347 None] Lock "cinder-a8e3bfb7-bfed-47ab-98ca-afacc1b6ab1a-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:24 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 1G Sep 28 12:15:24 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:25 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 1G" returned: 0 in 0.621s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e77c081-4294-44de-a386-f78ea25b2a92 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:25 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e77c081-4294-44de-a386-f78ea25b2a92 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 Sep 28 12:15:25 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:25 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e77c081-4294-44de-a386-f78ea25b2a92 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9" returned: 0 in 0.600s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:25 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:26 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 Sep 28 12:15:26 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:26 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9" returned: 0 in 0.380s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:26 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.info Sep 28 12:15:26 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:26 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.info" returned: 0 in 0.408s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:26 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:26 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.info Sep 28 12:15:26 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:27 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.info" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e2bfec55-1715-4e4b-b7a3-75525091b8bc tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 2da191a0-0ddb-40d5-9aa2-9745ad0e44e6: created successfully Sep 28 12:15:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 2da191a0-0ddb-40d5-9aa2-9745ad0e44e6: deleting Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 2da191a0-0ddb-40d5-9aa2-9745ad0e44e6: deleting {{(pid=87167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-a82bd6ac-f323-4406-8f65-b089fe156d0b" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-a82bd6ac-f323-4406-8f65-b089fe156d0b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-17592374-032c-4bc1-804d-8a622224a8a8" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-17592374-032c-4bc1-804d-8a622224a8a8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Deleting offline snapshot 17592374-032c-4bc1-804d-8a622224a8a8 of volume a82bd6ac-f323-4406-8f65-b089fe156d0b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] snapshot_file for this snap is: volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded0b3e-c0ae-487d-ad7d-07017e1aed2f]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:27 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 Sep 28 12:15:27 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:28 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8" returned: 0 in 0.545s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a82bd6ac-f323-4406-8f65-b089fe156d0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:15:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b08779-05a4-4c48-863e-ddbcbd427f30]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:28 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b Sep 28 12:15:28 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:28 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b" returned: 0 in 0.419s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:28 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 Sep 28 12:15:28 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:29 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8" returned: 0 in 0.436s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:29 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8 Sep 28 12:15:29 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:29 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b.17592374-032c-4bc1-804d-8a622224a8a8" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-17592374-032c-4bc1-804d-8a622224a8a8" released by "_delete_snapshot" :: held 1.865s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-a82bd6ac-f323-4406-8f65-b089fe156d0b" released by "delete_snapshot" :: held 1.915s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-6e77c081-4294-44de-a386-f78ea25b2a92" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-6e77c081-4294-44de-a386-f78ea25b2a92" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-2667f0d7-a276-45be-8900-21dd76902da9" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-2667f0d7-a276-45be-8900-21dd76902da9" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Deleting offline snapshot 2667f0d7-a276-45be-8900-21dd76902da9 of volume 6e77c081-4294-44de-a386-f78ea25b2a92 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] snapshot_file for this snap is: volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ea15e-eba5-4b73-84ae-b0eafdaef08c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:29 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 Sep 28 12:15:29 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:30 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9" returned: 0 in 0.662s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e77c081-4294-44de-a386-f78ea25b2a92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:15:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d8ee80-5077-4ded-924d-ce2b9e3ffeb3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:30 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 Sep 28 12:15:30 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:30 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92" returned: 0 in 0.539s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:31 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 Sep 28 12:15:31 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:31 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9" returned: 0 in 0.603s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:31 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9 Sep 28 12:15:31 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-894345a9-eaad-4e3a-abb9-0b6d55565049 req-9de35cb6-a664-439a-8e94-8d22ccd38e83 tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-894345a9-eaad-4e3a-abb9-0b6d55565049 req-9de35cb6-a664-439a-8e94-8d22ccd38e83 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-894345a9-eaad-4e3a-abb9-0b6d55565049 req-9de35cb6-a664-439a-8e94-8d22ccd38e83 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-894345a9-eaad-4e3a-abb9-0b6d55565049 req-9de35cb6-a664-439a-8e94-8d22ccd38e83 tempest-ServerActionsTestOtherA-175313115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-bb031878-aad3-468e-8ec9-56bade96dbf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f13d1675-9340-44ba-b822-3a07126c6cff', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:15:31 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92.2667f0d7-a276-45be-8900-21dd76902da9" returned: 0 in 0.307s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-2667f0d7-a276-45be-8900-21dd76902da9" released by "_delete_snapshot" :: held 2.278s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-894345a9-eaad-4e3a-abb9-0b6d55565049 req-9de35cb6-a664-439a-8e94-8d22ccd38e83 tempest-ServerActionsTestOtherA-175313115 None] attachment_update completed successfully. Sep 28 12:15:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-6e77c081-4294-44de-a386-f78ea25b2a92" released by "delete_snapshot" :: held 2.316s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:32 devstack cinder-volume[87167]: WARNING cinder.quota [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1475119588 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1475119588, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:32 devstack cinder-volume[87167]: WARNING cinder.quota [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1475119588 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1475119588, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:32 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['4a72bfa6-e77c-48d9-9a70-c19c2134a8dc', '70feccd2-07a3-4d1f-97a8-cf080e5c5edf', '4adba961-3e1a-40fb-92ce-c63282382d87', '1929d9d4-9b68-4246-a0ed-3a39ec315ad9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:32 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['9488b027-af06-4269-9ef5-99a92c5a8208', '5034edbe-2cf9-4b9f-bf33-927f99cd2d31', 'c7bbf100-486c-41da-b77c-4d426cbd1559', '9c8e303a-19f0-4104-b9fa-c7a921a97bd6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0f3c450a-77e5-4ae7-abda-6a45c8fb6bc3 tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 2da191a0-0ddb-40d5-9aa2-9745ad0e44e6: deleted successfully Sep 28 12:15:32 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=107,cinder:UPDATE=86,cinder:DELETE=2,cinder:INSERT=16 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:15:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-6e77c081-4294-44de-a386-f78ea25b2a92" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-6e77c081-4294-44de-a386-f78ea25b2a92" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4929427-dfdc-4990-abdc-a9f8d27312d7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:33 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 Sep 28 12:15:33 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:33 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92" returned: 0 in 0.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:33 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92 Sep 28 12:15:33 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:33 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e77c081-4294-44de-a386-f78ea25b2a92" returned: 0 in 0.307s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-6e77c081-4294-44de-a386-f78ea25b2a92" released by "delete_volume" :: held 0.812s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-a82bd6ac-f323-4406-8f65-b089fe156d0b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-a82bd6ac-f323-4406-8f65-b089fe156d0b" acquired by "delete_volume" :: waited 0.048s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d498a62-296f-45a9-aa5a-f29a18596838]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:34 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b Sep 28 12:15:34 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:34 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b" returned: 0 in 0.397s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:34 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b Sep 28 12:15:34 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:34 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a82bd6ac-f323-4406-8f65-b089fe156d0b" returned: 0 in 0.250s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-a82bd6ac-f323-4406-8f65-b089fe156d0b" released by "delete_volume" :: held 0.740s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:34 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=104,cinder:UPDATE=83,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:15:34 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['3ef6f3e7-f13e-4224-9cf0-617afc3eb9c2'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:34 devstack cinder-volume[87167]: WARNING cinder.quota [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1475119588 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1475119588, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:34 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['7208152d-33bf-4558-b2d4-113eeaee314a', '2ad66bae-1c41-4844-aff6-ae85df85bf7b', '129e74f6-2f5f-4545-8032-7413358b0d0d', 'b4f506a9-39d0-45bc-b423-643b7fc57ea2'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:34 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['50d9c024-fc21-425d-ae31-a578481564ba', 'b2e7f4af-9fcc-4df2-ba73-a8103575c324', '16e4e5e2-6460-4f71-ad1a-a231bc6978be', '4938df15-a381-45f9-a92f-6856164912f1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:35 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:15:35 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:35 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.342s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:35 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-53df949a-ff78-4f3b-849b-719268ed2f85 tempest-GroupSnapshotsTest-1516001785 None] Delete group completed successfully. Sep 28 12:15:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ccf1bce6-3d49-49a0-8b94-b55c09100e44 tempest-GroupSnapshotsTest-1516001785 None] Group tempest-GroupSnapshotsTest-Group-254643936: creating Sep 28 12:15:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ccf1bce6-3d49-49a0-8b94-b55c09100e44 tempest-GroupSnapshotsTest-1516001785 None] Group tempest-GroupSnapshotsTest-Group-254643936: created successfully Sep 28 12:15:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ccf1bce6-3d49-49a0-8b94-b55c09100e44 tempest-GroupSnapshotsTest-1516001785 None] Create group completed successfully. Sep 28 12:15:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-5a617087-fa24-43b1-ac31-e3f9cc9af067 req-d6a66c56-c59e-4d37-ac56-3c21a67d1f69 tempest-ServerActionsTestOtherA-175313115 None] Terminate volume connection completed successfully. Sep 28 12:15:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-5a617087-fa24-43b1-ac31-e3f9cc9af067 req-d6a66c56-c59e-4d37-ac56-3c21a67d1f69 tempest-ServerActionsTestOtherA-175313115 None] Deleting attachment f13d1675-9340-44ba-b822-3a07126c6cff. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-5a617087-fa24-43b1-ac31-e3f9cc9af067 req-eaa9d25e-335f-4e1e-8659-05a1faab462b tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-5a617087-fa24-43b1-ac31-e3f9cc9af067 req-eaa9d25e-335f-4e1e-8659-05a1faab462b tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-5a617087-fa24-43b1-ac31-e3f9cc9af067 req-eaa9d25e-335f-4e1e-8659-05a1faab462b tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-5a617087-fa24-43b1-ac31-e3f9cc9af067 req-eaa9d25e-335f-4e1e-8659-05a1faab462b tempest-ServerActionsTestOtherA-175313115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-bb031878-aad3-468e-8ec9-56bade96dbf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9131fe26-de99-4424-88e1-784d8a328266', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:15:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-5a617087-fa24-43b1-ac31-e3f9cc9af067 req-eaa9d25e-335f-4e1e-8659-05a1faab462b tempest-ServerActionsTestOtherA-175313115 None] attachment_update completed successfully. Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Flow 'volume_create_manager' (9b47a4b0-1cbb-47a9-b5f5-586ff3c58009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91bbd4b-5ff1-4d21-9468-b1d659ef74a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f91bbd4b-5ff1-4d21-9468-b1d659ef74a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-478050820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65b1d0eb-9e11-489d-a8bb-ca22666a166d,host='devstack@QuobyteHD#QuobyteHD',id=65a1b860-cea5-469c-a93c-8111d9622a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74da342ba497482fac265a84b19b675c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:38Z,use_quota=True,user_id='fe4c0f8027b840ce8f8e2fb0ba3155c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8550657-2106-46e6-ac68-84d282c249b7),volume_type_id=a8550657-2106-46e6-ac68-84d282c249b7)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f070198-8822-4478-a010-3620c531c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f070198-8822-4478-a010-3620c531c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b176ed8-4034-4484-8288-cec1ee73d8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b176ed8-4034-4484-8288-cec1ee73d8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a1b860-cea5-469c-a93c-8111d9622a4f', 'volume_name': 'volume-65a1b860-cea5-469c-a93c-8111d9622a4f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d48ebb8-da53-466f-89d2-0376c02f3a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d48ebb8-da53-466f-89d2-0376c02f3a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9808c48b-22ff-4226-9a88-5aef00018881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:37 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Volume 65a1b860-cea5-469c-a93c-8111d9622a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a1b860-cea5-469c-a93c-8111d9622a4f', 'volume_size': 1} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=65b1d0eb-9e11-489d-a8bb-ca22666a166d,created_at=2026-09-28T10:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-478050820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65b1d0eb-9e11-489d-a8bb-ca22666a166d,host='devstack@QuobyteHD#QuobyteHD',id=65a1b860-cea5-469c-a93c-8111d9622a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74da342ba497482fac265a84b19b675c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:38Z,use_quota=True,user_id='fe4c0f8027b840ce8f8e2fb0ba3155c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8550657-2106-46e6-ac68-84d282c249b7),volume_type_id=a8550657-2106-46e6-ac68-84d282c249b7)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Creating volume 65a1b860-cea5-469c-a93c-8111d9622a4f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:37 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:15:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:37 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f 1073741824 Sep 28 12:15:37 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:38 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f 1073741824" returned: 0 in 0.506s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:38 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f Sep 28 12:15:38 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:39 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f" returned: 0 in 0.496s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9808c48b-22ff-4226-9a88-5aef00018881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a1b860-cea5-469c-a93c-8111d9622a4f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feda6fa8-7042-4f54-8b32-74aec310feea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:39 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Volume volume-65a1b860-cea5-469c-a93c-8111d9622a4f (65a1b860-cea5-469c-a93c-8111d9622a4f): created successfully Sep 28 12:15:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feda6fa8-7042-4f54-8b32-74aec310feea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Flow 'volume_create_manager' (9b47a4b0-1cbb-47a9-b5f5-586ff3c58009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-de3e46ac-8e9e-4a0b-b61f-c5fdd81c7b8d tempest-GroupSnapshotsTest-1516001785 None] Created volume successfully. Sep 28 12:15:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] GroupSnapshot 2ecb8496-d428-498f-8b4a-3e0cfe35a026: creating. Sep 28 12:15:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Group snapshot 2ecb8496-d428-498f-8b4a-3e0cfe35a026: creating. {{(pid=87167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 12:15:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Creating offline snapshot 9ae5af18-0d1c-4b9f-a059-edf96e9a1110 of volume 65a1b860-cea5-469c-a93c-8111d9622a4f {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:15:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f816a2-8211-40eb-ac6b-95d27cad55f6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:40 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f Sep 28 12:15:40 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:41 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f" returned: 0 in 0.443s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:41 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 1G Sep 28 12:15:41 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:41 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 1G" returned: 0 in 0.603s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a1b860-cea5-469c-a93c-8111d9622a4f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:41 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a1b860-cea5-469c-a93c-8111d9622a4f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 Sep 28 12:15:41 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:42 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a1b860-cea5-469c-a93c-8111d9622a4f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110" returned: 0 in 0.840s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:42 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:42 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 Sep 28 12:15:42 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:43 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110" returned: 0 in 0.416s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:43 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.info Sep 28 12:15:43 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-6480c56c-2b2e-43a3-bb09-1f2d65c1d6a7 req-3cd3a0a5-0bd8-4eab-aa99-6944973f774a tempest-AttachVolumeTestJSON-309856177 None] Terminate volume connection completed successfully. Sep 28 12:15:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-6480c56c-2b2e-43a3-bb09-1f2d65c1d6a7 req-3cd3a0a5-0bd8-4eab-aa99-6944973f774a tempest-AttachVolumeTestJSON-309856177 None] Deleting attachment fdcf14d4-7429-450c-b5e4-8304e8724a63. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:15:43 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.info" returned: 0 in 0.433s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:43 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:43 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.info Sep 28 12:15:43 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:44 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.info" returned: 0 in 0.572s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.462s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f370c5d5-4dd6-4dc4-bd84-d92adcdc400b tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 2ecb8496-d428-498f-8b4a-3e0cfe35a026: created successfully Sep 28 12:15:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 2ecb8496-d428-498f-8b4a-3e0cfe35a026: deleting Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 2ecb8496-d428-498f-8b4a-3e0cfe35a026: deleting {{(pid=87167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-65a1b860-cea5-469c-a93c-8111d9622a4f" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-65a1b860-cea5-469c-a93c-8111d9622a4f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-9ae5af18-0d1c-4b9f-a059-edf96e9a1110" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-9ae5af18-0d1c-4b9f-a059-edf96e9a1110" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Deleting offline snapshot 9ae5af18-0d1c-4b9f-a059-edf96e9a1110 of volume 65a1b860-cea5-469c-a93c-8111d9622a4f {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] snapshot_file for this snap is: volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12e66ef-7138-459e-bff5-b91b0e732201]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:45 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 Sep 28 12:15:45 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:45 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110" returned: 0 in 0.531s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65a1b860-cea5-469c-a93c-8111d9622a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:15:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[588436df-4b38-499e-a846-829c781171e3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:46 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f Sep 28 12:15:46 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:46 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f" returned: 0 in 0.508s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:46 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 Sep 28 12:15:46 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:47 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110" returned: 0 in 0.647s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:47 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110 Sep 28 12:15:47 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:47 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f.9ae5af18-0d1c-4b9f-a059-edf96e9a1110" returned: 0 in 0.500s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-9ae5af18-0d1c-4b9f-a059-edf96e9a1110" released by "_delete_snapshot" :: held 2.442s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-65a1b860-cea5-469c-a93c-8111d9622a4f" released by "delete_snapshot" :: held 2.500s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:47 devstack cinder-volume[87167]: WARNING cinder.quota [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1086604166 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1086604166, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:47 devstack cinder-volume[87167]: WARNING cinder.quota [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1086604166 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1086604166, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:48 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['cb48e282-181b-450a-b0f8-9115787bc2f2', '03366550-112c-4b0e-87b3-dfb1d1e98e10', 'a76f9aa2-9f29-445a-bb72-a1a02485122e', 'd9b7be63-dd40-47e8-b176-1c987e492338'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7a60ae9c-c1d9-4cc2-86a0-b3b4c2480dcf tempest-GroupSnapshotsTest-1516001785 None] group_snapshot 2ecb8496-d428-498f-8b4a-3e0cfe35a026: deleted successfully Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:49 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:15:49 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "cinder-quobyte-65a1b860-cea5-469c-a93c-8111d9622a4f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-65a1b860-cea5-469c-a93c-8111d9622a4f" acquired by "delete_volume" :: waited 0.068s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff0b930-f499-4c62-aa78-35972d5b42f3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:50 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f Sep 28 12:15:50 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:50 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 1.054s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 8 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:15:50 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f" returned: 0 in 0.658s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:50 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f Sep 28 12:15:50 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:51 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65a1b860-cea5-469c-a93c-8111d9622a4f" returned: 0 in 0.538s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Lock "cinder-quobyte-65a1b860-cea5-469c-a93c-8111d9622a4f" released by "delete_volume" :: held 1.506s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['bbf03a70-641d-4406-bdd7-1d295835269e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:51 devstack cinder-volume[87167]: WARNING cinder.quota [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1086604166 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1086604166, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Created reservations ['a6e5d454-6aad-4bcd-8758-145b10116a11', '729a4570-8c80-4576-a71b-e1bdcf1b9b5f', 'ac748955-57b9-4883-adcc-2e7d35a61c19', '9809fd4b-8974-477a-b1ae-3661d94bc5df'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:51 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:15:51 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:52 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.597s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3a927e1e-ffb4-4a50-84ef-3ec8af648df3 tempest-GroupSnapshotsTest-1516001785 None] Delete group completed successfully. Sep 28 12:16:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-51c93eb9-fbca-451f-8d95-e868c9dc4d55 tempest-GroupsTest-1129503007 None] Group tempest-Group1-1994143752: creating Sep 28 12:16:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-51c93eb9-fbca-451f-8d95-e868c9dc4d55 tempest-GroupsTest-1129503007 None] Group tempest-Group1-1994143752: created successfully Sep 28 12:16:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-51c93eb9-fbca-451f-8d95-e868c9dc4d55 tempest-GroupsTest-1129503007 None] Create group completed successfully. Sep 28 12:16:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d7314659-e0bc-4149-b7b9-8cf13c11e7bf tempest-GroupsTest-1129503007 None] Group tempest-Group2-1342477291: creating Sep 28 12:16:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d7314659-e0bc-4149-b7b9-8cf13c11e7bf tempest-GroupsTest-1129503007 None] Group tempest-Group2-1342477291: created successfully Sep 28 12:16:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d7314659-e0bc-4149-b7b9-8cf13c11e7bf tempest-GroupsTest-1129503007 None] Create group completed successfully. Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Flow 'volume_create_manager' (144b1119-f8c7-4a7e-b599-1e9c2993366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7caf1a-4564-4285-941d-31e854eecd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7caf1a-4564-4285-941d-31e854eecd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1955028031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9236ebf4-6146-440c-ad07-d849b93c6eea,host='devstack@QuobyteHD#QuobyteHD',id=97e1f0e6-ad3c-403d-89fd-aeb48a80fb71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dacd84014bd4ad88a937cc943a66ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:04Z,use_quota=True,user_id='5fad6f56905849589c9a2b85b3e9698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef17ea0d-c67c-4a69-8829-62aa47fffbd1),volume_type_id=ef17ea0d-c67c-4a69-8829-62aa47fffbd1)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9d2db5-5a5f-403f-a395-4b48c2069d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9d2db5-5a5f-403f-a395-4b48c2069d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d87563d-f627-4bc5-a9ca-bc3f235922c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d87563d-f627-4bc5-a9ca-bc3f235922c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e1f0e6-ad3c-403d-89fd-aeb48a80fb71', 'volume_name': 'volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a760be2-390a-40ce-aa95-d46b637f9bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a760be2-390a-40ce-aa95-d46b637f9bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f614b02-f939-48c0-9a8d-4a779bb54c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Volume 97e1f0e6-ad3c-403d-89fd-aeb48a80fb71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71', 'volume_size': 1} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9236ebf4-6146-440c-ad07-d849b93c6eea,created_at=2026-09-28T10:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1955028031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9236ebf4-6146-440c-ad07-d849b93c6eea,host='devstack@QuobyteHD#QuobyteHD',id=97e1f0e6-ad3c-403d-89fd-aeb48a80fb71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dacd84014bd4ad88a937cc943a66ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:04Z,use_quota=True,user_id='5fad6f56905849589c9a2b85b3e9698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef17ea0d-c67c-4a69-8829-62aa47fffbd1),volume_type_id=ef17ea0d-c67c-4a69-8829-62aa47fffbd1)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Creating volume 97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:16:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:04 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 1073741824 Sep 28 12:16:04 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:05 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 1073741824" returned: 0 in 0.833s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:05 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 Sep 28 12:16:05 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:06 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71" returned: 0 in 0.603s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f614b02-f939-48c0-9a8d-4a779bb54c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de70a806-33c5-4b96-8e59-21632154f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Volume volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 (97e1f0e6-ad3c-403d-89fd-aeb48a80fb71): created successfully Sep 28 12:16:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de70a806-33c5-4b96-8e59-21632154f15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Flow 'volume_create_manager' (144b1119-f8c7-4a7e-b599-1e9c2993366a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4c1df2a3-f0f9-4646-a285-61c9c58240f6 tempest-GroupsTest-1129503007 None] Created volume successfully. Sep 28 12:16:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-4589e859-ea69-45ff-a0b4-2c2a3a8cc02e req-e830d1db-d2c0-4166-ae76-d7bfb3a7b2a8 tempest-ServerActionsTestOtherA-175313115 None] Terminate volume connection completed successfully. Sep 28 12:16:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-4589e859-ea69-45ff-a0b4-2c2a3a8cc02e req-e830d1db-d2c0-4166-ae76-d7bfb3a7b2a8 tempest-ServerActionsTestOtherA-175313115 None] Deleting attachment 9131fe26-de99-4424-88e1-784d8a328266. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:16:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Acquiring lock "cinder-quobyte-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Lock "cinder-quobyte-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13f1d8d-4d5d-4f9f-9e33-571d4c70a559]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:07 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 Sep 28 12:16:07 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:08 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71" returned: 0 in 0.511s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:08 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71 Sep 28 12:16:08 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:08 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71" returned: 0 in 0.371s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Lock "cinder-quobyte-97e1f0e6-ad3c-403d-89fd-aeb48a80fb71" released by "delete_volume" :: held 0.964s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:08 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Created reservations ['18d7e9bf-36b5-4470-b89c-f7c44df5aa05'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:08 devstack cinder-volume[87167]: WARNING cinder.quota [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-534028849 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-534028849, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:16:08 devstack cinder-volume[87167]: WARNING cinder.quota [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-534028849 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-534028849, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:16:08 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Created reservations ['b4b090d6-52d0-48fc-a63f-86d07235afaf', '77d318ec-e328-4252-94eb-612fd34b8cf3', 'e95a084e-d767-479e-95ca-c620ec2b8b55', 'd03f2b7f-6933-4a8d-9f2a-c477538f67ca'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:09 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:16:09 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:09 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.268s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:09 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-68607e1b-1d2b-4123-a451-ca106f4fa778 tempest-GroupsTest-1129503007 None] Delete group completed successfully. Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Created reservations ['1e1a6559-3126-4b10-a1f2-d82b2c56e3e1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:10 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:16:10 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:10 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.333s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:10 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8deb0bd5-5f55-4a48-ab32-4fe810110aef tempest-GroupsTest-1129503007 None] Delete group completed successfully. Sep 28 12:16:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2d3df588-cef4-49cc-a8ba-81d759e69e96 tempest-GroupsTest-1129503007 None] Group tempest-GroupsTest-Group-134832447: creating Sep 28 12:16:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2d3df588-cef4-49cc-a8ba-81d759e69e96 tempest-GroupsTest-1129503007 None] Group tempest-GroupsTest-Group-134832447: created successfully Sep 28 12:16:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2d3df588-cef4-49cc-a8ba-81d759e69e96 tempest-GroupsTest-1129503007 None] Create group completed successfully. Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Flow 'volume_create_manager' (d098062a-dc4c-40f0-8422-46fe184458ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64257458-a059-4458-93c5-944571b1073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64257458-a059-4458-93c5-944571b1073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1753399735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3e9f0c6-9d5f-42b8-a211-d26fb56f7d28,host='devstack@QuobyteHD#QuobyteHD',id=3e0c0a56-8ab2-49e9-96eb-c18b89fb2107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dacd84014bd4ad88a937cc943a66ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:14Z,use_quota=True,user_id='5fad6f56905849589c9a2b85b3e9698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47226352-52dc-4327-8d8c-978aa50888ad),volume_type_id=47226352-52dc-4327-8d8c-978aa50888ad)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77d5646-7d93-4f5b-b929-84d34a4cdb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77d5646-7d93-4f5b-b929-84d34a4cdb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14aef1d-c134-476e-aed3-32d5fc6760ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14aef1d-c134-476e-aed3-32d5fc6760ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0c0a56-8ab2-49e9-96eb-c18b89fb2107', 'volume_name': 'volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de21eef5-4c5c-4144-adb3-bb7bbbd39b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de21eef5-4c5c-4144-adb3-bb7bbbd39b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00709405-505a-4b78-863a-a83b24ae1a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Volume 3e0c0a56-8ab2-49e9-96eb-c18b89fb2107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107', 'volume_size': 1} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3e9f0c6-9d5f-42b8-a211-d26fb56f7d28,created_at=2026-09-28T10:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1753399735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3e9f0c6-9d5f-42b8-a211-d26fb56f7d28,host='devstack@QuobyteHD#QuobyteHD',id=3e0c0a56-8ab2-49e9-96eb-c18b89fb2107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dacd84014bd4ad88a937cc943a66ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:14Z,use_quota=True,user_id='5fad6f56905849589c9a2b85b3e9698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47226352-52dc-4327-8d8c-978aa50888ad),volume_type_id=47226352-52dc-4327-8d8c-978aa50888ad)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Creating volume 3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:13 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:16:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:14 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 1073741824 Sep 28 12:16:14 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:14 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 1073741824" returned: 0 in 0.670s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:14 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 Sep 28 12:16:14 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Flow 'volume_create_manager' (01d65e0b-c2bc-419d-845f-1d1218a4b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5071b3e9-b2aa-4564-be6b-a1f109407302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5071b3e9-b2aa-4564-be6b-a1f109407302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1148002579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3196524a-18da-4c1f-8f8a-de065fa505ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922f99415e2241e797224a121518c465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:15Z,use_quota=True,user_id='c6de6994af774f2690503de9f8dee63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab83859a-89f7-4470-bf52-4a5ba88495be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab83859a-89f7-4470-bf52-4a5ba88495be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69257e1a-61ed-4746-8d9f-65e58ac09290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:16:15 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107" returned: 0 in 0.452s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00709405-505a-4b78-863a-a83b24ae1a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9518d8-3607-4c8a-90f7-5eeabf43f4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Volume volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 (3e0c0a56-8ab2-49e9-96eb-c18b89fb2107): created successfully Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9518d8-3607-4c8a-90f7-5eeabf43f4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Flow 'volume_create_manager' (d098062a-dc4c-40f0-8422-46fe184458ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-429d0f87-12b2-4fd7-b4b0-5593064d700c tempest-GroupsTest-1129503007 None] Created volume successfully. Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69257e1a-61ed-4746-8d9f-65e58ac09290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3196524a-18da-4c1f-8f8a-de065fa505ef', 'volume_name': 'volume-3196524a-18da-4c1f-8f8a-de065fa505ef', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a60ec7c-e65d-4338-97ce-9ba7a354abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a60ec7c-e65d-4338-97ce-9ba7a354abc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997d82a6-257b-49fa-ab8e-90cef12f19ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Volume 3196524a-18da-4c1f-8f8a-de065fa505ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3196524a-18da-4c1f-8f8a-de065fa505ef', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:16:15 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Trying to clone 3196524a-18da-4c1f-8f8a-de065fa505ef from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:16:16 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:16:16 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:16:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b554731f-dc31-45d2-9751-eb8bbd42793d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:16 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD Sep 28 12:16:16 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:16 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:16 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a is fetched for user c6de6994af774f2690503de9f8dee63f. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:16:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf84728-0267-4704-8708-679049f00eb1]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:16 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD Sep 28 12:16:16 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:17 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1148002579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3196524a-18da-4c1f-8f8a-de065fa505ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922f99415e2241e797224a121518c465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:15Z,use_quota=True,user_id='c6de6994af774f2690503de9f8dee63f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Creating volume 3196524a-18da-4c1f-8f8a-de065fa505ef {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:17 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:17 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef 1073741824 Sep 28 12:16:17 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Flow 'volume_create_manager' (1cedcd66-1761-4ba2-9893-bce558919197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2c9c58-de47-4e9a-8e9d-fa784efdfae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2c9c58-de47-4e9a-8e9d-fa784efdfae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851460720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3e9f0c6-9d5f-42b8-a211-d26fb56f7d28,host='devstack@QuobyteHD#QuobyteHD',id=e14cd6ba-5eda-4aff-aa0c-7f645e8f742e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dacd84014bd4ad88a937cc943a66ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:17Z,use_quota=True,user_id='5fad6f56905849589c9a2b85b3e9698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47226352-52dc-4327-8d8c-978aa50888ad),volume_type_id=47226352-52dc-4327-8d8c-978aa50888ad)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29135229-96e5-4cb1-b06f-2ba43b80a6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29135229-96e5-4cb1-b06f-2ba43b80a6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3635c938-ef9d-4cce-a91e-4be12f084586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3635c938-ef9d-4cce-a91e-4be12f084586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14cd6ba-5eda-4aff-aa0c-7f645e8f742e', 'volume_name': 'volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6deaf9-256a-4870-95fc-3b1f7f80494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6deaf9-256a-4870-95fc-3b1f7f80494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd14996-f344-4b4a-9013-879abdfd7bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Volume e14cd6ba-5eda-4aff-aa0c-7f645e8f742e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e', 'volume_size': 1} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:17 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef 1073741824" returned: 0 in 0.487s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:17 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef Sep 28 12:16:17 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:18 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef" returned: 0 in 0.272s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3e9f0c6-9d5f-42b8-a211-d26fb56f7d28,created_at=2026-09-28T10:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851460720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3e9f0c6-9d5f-42b8-a211-d26fb56f7d28,host='devstack@QuobyteHD#QuobyteHD',id=e14cd6ba-5eda-4aff-aa0c-7f645e8f742e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dacd84014bd4ad88a937cc943a66ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:17Z,use_quota=True,user_id='5fad6f56905849589c9a2b85b3e9698e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47226352-52dc-4327-8d8c-978aa50888ad),volume_type_id=47226352-52dc-4327-8d8c-978aa50888ad)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Creating volume e14cd6ba-5eda-4aff-aa0c-7f645e8f742e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:18 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:18 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e 1073741824 Sep 28 12:16:18 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Attempting download of 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume 3196524a-18da-4c1f-8f8a-de065fa505ef. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ac6a8b-a471-46a1-944c-ad6bfd5ab687]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_9rz9z87d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:18 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_9rz9z87d Sep 28 12:16:18 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:18 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_9rz9z87d" returned: 0 in 0.430s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_9rz9z87d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:18 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e 1073741824" returned: 0 in 0.594s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:18 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e Sep 28 12:16:18 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:18 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_9rz9z87d Sep 28 12:16:18 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:18 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:18 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e" returned: 0 in 0.301s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_9rz9z87d" returned: 1 in 0.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_9rz9z87d' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3a25ff-cb02-4152-a509-c8958b359628]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd14996-f344-4b4a-9013-879abdfd7bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ff827a-7ffb-4a0b-83de-02701a381549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:19 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Volume volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e (e14cd6ba-5eda-4aff-aa0c-7f645e8f742e): created successfully Sep 28 12:16:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ff827a-7ffb-4a0b-83de-02701a381549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Flow 'volume_create_manager' (1cedcd66-1761-4ba2-9893-bce558919197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-51a37286-a4b4-4b18-b759-100a95a29e9b tempest-GroupsTest-1129503007 None] Created volume successfully. Sep 28 12:16:19 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD Sep 28 12:16:19 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:19 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:19 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] 1001d1e1-2632-478f-a3a3-396a6f86ff9a was qcow2, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:16:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:19 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef Sep 28 12:16:19 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-072ec6fa-fed0-4f7a-a35f-d85e0e6988f7 tempest-GroupsTest-1129503007 None] Update group completed successfully. Sep 28 12:16:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ab741b8d-4cf2-4df2-983e-4cbaacb3b5d2 tempest-GroupsTest-1129503007 None] Update group completed successfully. Sep 28 12:16:21 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef" returned: 0 in 2.529s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:21 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_0thixrmcdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:16:21 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Converted 112.00 MB image at 44.26 MB/s Sep 28 12:16:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:21 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef 1G Sep 28 12:16:21 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:22 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef 1G" returned: 0 in 0.434s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Downloaded image 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume 3196524a-18da-4c1f-8f8a-de065fa505ef successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a for user c6de6994af774f2690503de9f8dee63f is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Marking volume 3196524a-18da-4c1f-8f8a-de065fa505ef as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Copying metadata from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a to 3196524a-18da-4c1f-8f8a-de065fa505ef. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Creating volume glance metadata for volume 3196524a-18da-4c1f-8f8a-de065fa505ef backed by image 1001d1e1-2632-478f-a3a3-396a6f86ff9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997d82a6-257b-49fa-ab8e-90cef12f19ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3196524a-18da-4c1f-8f8a-de065fa505ef', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10a3a32-f507-4355-a994-55902339b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:22 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Volume volume-3196524a-18da-4c1f-8f8a-de065fa505ef (3196524a-18da-4c1f-8f8a-de065fa505ef): created successfully Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10a3a32-f507-4355-a994-55902339b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Flow 'volume_create_manager' (01d65e0b-c2bc-419d-845f-1d1218a4b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-986d5cff-8576-4051-8654-ef606e25b95f tempest-ServerActionsTestOtherA-175313115 None] Created volume successfully. Sep 28 12:16:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Acquiring lock "cinder-quobyte-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Lock "cinder-quobyte-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c6b768-cbef-4ae2-8bad-6f19ae9e5c1b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:23 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 Sep 28 12:16:23 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:23 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107" returned: 0 in 0.512s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:23 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107 Sep 28 12:16:23 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:24 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107" returned: 0 in 0.340s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Lock "cinder-quobyte-3e0c0a56-8ab2-49e9-96eb-c18b89fb2107" released by "delete_volume" :: held 0.916s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Acquiring lock "cinder-quobyte-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Lock "cinder-quobyte-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf0945-b266-4a96-a47c-c248574c63ec]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:24 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e Sep 28 12:16:24 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:24 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e" returned: 0 in 0.524s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:24 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e Sep 28 12:16:24 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:25 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e" returned: 0 in 0.337s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Lock "cinder-quobyte-e14cd6ba-5eda-4aff-aa0c-7f645e8f742e" released by "delete_volume" :: held 0.924s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Created reservations ['238c3111-fbe9-4ef2-937e-86e55b6ffcc1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:25 devstack cinder-volume[87167]: WARNING cinder.quota [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1431697011 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1431697011, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:16:25 devstack cinder-volume[87167]: WARNING cinder.quota [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1431697011 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1431697011, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Created reservations ['26889857-f784-4c29-af16-1638b1e5af55', 'ea82f033-c78b-4e4f-b78e-e4fce4e0a72d', '1b4a6a69-899c-468b-84c3-20ae0f5a0049', '662c96da-a949-45f3-bf39-625bfb78ec94'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Created reservations ['fb79749c-1730-450d-9bf8-63012823aa18', '61fa1681-deda-47d4-b9ff-39136ea65987', '911e736b-79f4-4c83-9959-7363647caac9', 'fb7f7654-0851-4d77-913e-9f519506bce9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Flow 'volume_create_manager' (d0d6f4cd-a764-42ae-9d4d-c1c5aa21a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c5fef6-ad16-4995-b523-2855f1824aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c5fef6-ad16-4995-b523-2855f1824aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1356591757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8682733e-fd1e-4142-979d-2273993829c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0902bbc37f4a40a48ae14881736605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:25Z,use_quota=True,user_id='19e93c61751d4bfb8097b9f6078eb4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15099603-85a2-40e5-bd47-05b4bd3df510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15099603-85a2-40e5-bd47-05b4bd3df510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda52ef2-cfb1-4c5c-b0f9-f71f4ad502a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:25 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:16:25 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:26 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda52ef2-cfb1-4c5c-b0f9-f71f4ad502a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8682733e-fd1e-4142-979d-2273993829c1', 'volume_name': 'volume-8682733e-fd1e-4142-979d-2273993829c1', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5ab66c-c666-4b69-ace4-95506e9bb972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5ab66c-c666-4b69-ace4-95506e9bb972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11747127-6fb7-4f26-9f6d-2adcb612f7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Volume 8682733e-fd1e-4142-979d-2273993829c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8682733e-fd1e-4142-979d-2273993829c1', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Trying to clone 8682733e-fd1e-4142-979d-2273993829c1 from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8aaf0574-69e9-4f05-8d01-98a8870571b3 tempest-GroupsTest-1129503007 None] Delete group completed successfully. Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:16:26 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5d75f9-9d3d-445f-9d8e-672c4bb4f907]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:26 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD Sep 28 12:16:26 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-15f5fab8-9396-42f0-bb30-d059c73ecea5 req-3cf7e035-68d9-4376-b988-1e9fe3082f30 tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-15f5fab8-9396-42f0-bb30-d059c73ecea5 req-3cf7e035-68d9-4376-b988-1e9fe3082f30 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-15f5fab8-9396-42f0-bb30-d059c73ecea5 req-3cf7e035-68d9-4376-b988-1e9fe3082f30 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-15f5fab8-9396-42f0-bb30-d059c73ecea5 req-3cf7e035-68d9-4376-b988-1e9fe3082f30 tempest-ServerActionsTestOtherA-175313115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-3196524a-18da-4c1f-8f8a-de065fa505ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aab4cb5b-c19e-447b-b290-26d4c54d033d', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:16:27 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a is fetched for user 19e93c61751d4bfb8097b9f6078eb4b4. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:16:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-15f5fab8-9396-42f0-bb30-d059c73ecea5 req-3cf7e035-68d9-4376-b988-1e9fe3082f30 tempest-ServerActionsTestOtherA-175313115 None] attachment_update completed successfully. Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0c8ccd-5d81-404c-bc8c-cc2326dd1ed8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:27 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD Sep 28 12:16:27 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:27 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1356591757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8682733e-fd1e-4142-979d-2273993829c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0902bbc37f4a40a48ae14881736605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:25Z,use_quota=True,user_id='19e93c61751d4bfb8097b9f6078eb4b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Creating volume 8682733e-fd1e-4142-979d-2273993829c1 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:27 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:16:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:27 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 1073741824 Sep 28 12:16:27 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:28 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 1073741824" returned: 0 in 0.608s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:28 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 Sep 28 12:16:28 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:28 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1" returned: 0 in 0.313s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:28 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Attempting download of 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume 8682733e-fd1e-4142-979d-2273993829c1. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:16:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bbe487-a573-4723-acad-330d128c3326]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_cf6n7dhb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:28 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_cf6n7dhb Sep 28 12:16:28 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:29 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_cf6n7dhb" returned: 0 in 0.595s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_cf6n7dhb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:29 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_cf6n7dhb Sep 28 12:16:29 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:29 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_cf6n7dhb" returned: 1 in 0.498s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_cf6n7dhb' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:16:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb9594-e0c4-43f9-b4c6-8c5f35b0847d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:29 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD Sep 28 12:16:29 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:30 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:30 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] 1001d1e1-2632-478f-a3a3-396a6f86ff9a was qcow2, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:16:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:30 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 Sep 28 12:16:30 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:33 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1" returned: 0 in 3.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:33 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_qg_e0pc7devstack@QuobyteHD, size 112.00 MB, duration 3.37 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:16:33 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Converted 112.00 MB image at 33.26 MB/s Sep 28 12:16:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:33 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 1G Sep 28 12:16:33 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:34 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 1G" returned: 0 in 0.544s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Downloaded image 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume 8682733e-fd1e-4142-979d-2273993829c1 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a for user 19e93c61751d4bfb8097b9f6078eb4b4 is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Marking volume 8682733e-fd1e-4142-979d-2273993829c1 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Copying metadata from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a to 8682733e-fd1e-4142-979d-2273993829c1. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Creating volume glance metadata for volume 8682733e-fd1e-4142-979d-2273993829c1 backed by image 1001d1e1-2632-478f-a3a3-396a6f86ff9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=90,cinder:UPDATE=103,cinder:INSERT=31,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11747127-6fb7-4f26-9f6d-2adcb612f7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8682733e-fd1e-4142-979d-2273993829c1', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cb4532-1111-4630-becf-c65da0934d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Volume volume-8682733e-fd1e-4142-979d-2273993829c1 (8682733e-fd1e-4142-979d-2273993829c1): created successfully Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cb4532-1111-4630-becf-c65da0934d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Flow 'volume_create_manager' (d0d6f4cd-a764-42ae-9d4d-c1c5aa21a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-09addce7-9f17-40be-aff7-6387db8ddcd2 tempest-TestShelveInstance-1955475962 None] Created volume successfully. Sep 28 12:16:42 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=133,cinder:INSERT=32,cinder:UPDATE=93,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:16:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-56f1b36a-8f83-4401-a2be-9471d4d0075f req-cb2d3505-252d-4142-b37a-6733d0ef1c85 tempest-TestShelveInstance-1955475962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-56f1b36a-8f83-4401-a2be-9471d4d0075f req-cb2d3505-252d-4142-b37a-6733d0ef1c85 tempest-TestShelveInstance-1955475962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-56f1b36a-8f83-4401-a2be-9471d4d0075f req-cb2d3505-252d-4142-b37a-6733d0ef1c85 tempest-TestShelveInstance-1955475962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-56f1b36a-8f83-4401-a2be-9471d4d0075f req-cb2d3505-252d-4142-b37a-6733d0ef1c85 tempest-TestShelveInstance-1955475962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-8682733e-fd1e-4142-979d-2273993829c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ba25b54-ec7f-4d72-aed5-9345dd8f4af1', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:16:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-56f1b36a-8f83-4401-a2be-9471d4d0075f req-cb2d3505-252d-4142-b37a-6733d0ef1c85 tempest-TestShelveInstance-1955475962 None] attachment_update completed successfully. Sep 28 12:16:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:16:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:49 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:16:49 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:50 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.601s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:50 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:16:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:16:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:16:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-cbed9559-bcfb-46e7-957e-bd09cad5e73f req-8c2a9211-cabc-42f2-9c33-ec28351db87a tempest-ServerActionsTestOtherA-175313115 None] Terminate volume connection completed successfully. Sep 28 12:16:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-cbed9559-bcfb-46e7-957e-bd09cad5e73f req-8c2a9211-cabc-42f2-9c33-ec28351db87a tempest-ServerActionsTestOtherA-175313115 None] Deleting attachment aab4cb5b-c19e-447b-b290-26d4c54d033d. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:16:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-56f1b36a-8f83-4401-a2be-9471d4d0075f req-68213530-11ca-468f-ba8b-64c4330b12fd tempest-TestShelveInstance-1955475962 None] Terminate volume connection completed successfully. Sep 28 12:16:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-56f1b36a-8f83-4401-a2be-9471d4d0075f req-68213530-11ca-468f-ba8b-64c4330b12fd tempest-TestShelveInstance-1955475962 None] Deleting attachment 1ba25b54-ec7f-4d72-aed5-9345dd8f4af1. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:16:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-cbed9559-bcfb-46e7-957e-bd09cad5e73f req-07e8cb76-fd30-4c26-8ec6-c65165498a70 tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-cbed9559-bcfb-46e7-957e-bd09cad5e73f req-07e8cb76-fd30-4c26-8ec6-c65165498a70 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-cbed9559-bcfb-46e7-957e-bd09cad5e73f req-07e8cb76-fd30-4c26-8ec6-c65165498a70 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-cbed9559-bcfb-46e7-957e-bd09cad5e73f req-07e8cb76-fd30-4c26-8ec6-c65165498a70 tempest-ServerActionsTestOtherA-175313115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-3196524a-18da-4c1f-8f8a-de065fa505ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcba281a-f1f1-4357-b88f-f4f56a18794f', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:16:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-cbed9559-bcfb-46e7-957e-bd09cad5e73f req-07e8cb76-fd30-4c26-8ec6-c65165498a70 tempest-ServerActionsTestOtherA-175313115 None] attachment_update completed successfully. Sep 28 12:16:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Acquiring lock "cinder-8682733e-fd1e-4142-979d-2273993829c1-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Lock "cinder-8682733e-fd1e-4142-979d-2273993829c1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Acquiring lock "cinder-quobyte-8682733e-fd1e-4142-979d-2273993829c1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Lock "cinder-quobyte-8682733e-fd1e-4142-979d-2273993829c1" acquired by "delete_volume" :: waited 0.047s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[176d37cf-5d80-4943-ae7c-6d9650bed012]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:59 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 Sep 28 12:16:59 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:59 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1" returned: 0 in 0.830s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:59 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1 Sep 28 12:16:59 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:00 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8682733e-fd1e-4142-979d-2273993829c1" returned: 0 in 0.385s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Lock "cinder-quobyte-8682733e-fd1e-4142-979d-2273993829c1" released by "delete_volume" :: held 1.318s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG cinder.quota [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Created reservations ['8fac268f-b550-4ba9-9579-c2296d186917', 'da580874-5356-4403-a3ad-79956eed541c', 'fc59e9e9-594c-4098-9455-300537ff925d', '7414838e-76a3-4d3c-88e4-ace48d6b80f1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:00 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:00 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:01 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:01 devstack cinder-volume[87167]: DEBUG cinder.manager [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Deleted volume successfully. Sep 28 12:17:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b3dba69c-40f4-4d7c-94eb-b08545d6949f req-526e998d-852a-49bc-8a2e-7e1f66ecd2ed tempest-TestShelveInstance-1955475962 None] Lock "cinder-8682733e-fd1e-4142-979d-2273993829c1-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:10 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:INSERT=6,cinder:SELECT=26,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Flow 'volume_create_manager' (ce5032c8-99f8-4316-b752-ab4f567ebd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc21c71-ca84-44b0-8f49-77f15ea45fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc21c71-ca84-44b0-8f49-77f15ea45fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2068113162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cab1df1-c332-4fd0-a37b-4b482499b866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cccb8f97564d4eb4afd4dd865a047e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:12Z,use_quota=True,user_id='06350e207b9b47d3a3098365b608fd9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8203f5c-95b0-422b-9c0d-2ff07ffcbcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8203f5c-95b0-422b-9c0d-2ff07ffcbcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7584e647-1bbc-4011-a448-6f93ec6bdab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7584e647-1bbc-4011-a448-6f93ec6bdab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cab1df1-c332-4fd0-a37b-4b482499b866', 'volume_name': 'volume-3cab1df1-c332-4fd0-a37b-4b482499b866', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60c407c-ed24-49c8-96d4-bc4ba6ce8c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60c407c-ed24-49c8-96d4-bc4ba6ce8c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d900979f-9129-4052-92cd-1bfd6b6cc3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Volume 3cab1df1-c332-4fd0-a37b-4b482499b866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cab1df1-c332-4fd0-a37b-4b482499b866', 'volume_size': 1} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2068113162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cab1df1-c332-4fd0-a37b-4b482499b866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6cccb8f97564d4eb4afd4dd865a047e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:12Z,use_quota=True,user_id='06350e207b9b47d3a3098365b608fd9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Creating volume 3cab1df1-c332-4fd0-a37b-4b482499b866 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:11 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:11 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 1073741824 Sep 28 12:17:11 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:12 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 1073741824" returned: 0 in 0.618s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:12 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 Sep 28 12:17:12 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:12 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d900979f-9129-4052-92cd-1bfd6b6cc3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cab1df1-c332-4fd0-a37b-4b482499b866', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ce93e5-45d4-4160-9b00-32cb4bda912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Volume volume-3cab1df1-c332-4fd0-a37b-4b482499b866 (3cab1df1-c332-4fd0-a37b-4b482499b866): created successfully Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ce93e5-45d4-4160-9b00-32cb4bda912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Flow 'volume_create_manager' (ce5032c8-99f8-4316-b752-ab4f567ebd03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dd393ede-8cc4-4203-b77d-8fe790c51db6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Created volume successfully. Sep 28 12:17:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Creating offline snapshot 35727558-1b19-4346-bd2d-d156887fdc69 of volume 3cab1df1-c332-4fd0-a37b-4b482499b866 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:17:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[21392854-f1b1-4821-93e2-209b8e0a7842]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:14 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 Sep 28 12:17:14 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:14 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866" returned: 0 in 0.640s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:14 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 1G Sep 28 12:17:14 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:15 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 1G" returned: 0 in 0.450s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cab1df1-c332-4fd0-a37b-4b482499b866 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:15 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cab1df1-c332-4fd0-a37b-4b482499b866 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 Sep 28 12:17:15 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:15 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cab1df1-c332-4fd0-a37b-4b482499b866 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69" returned: 0 in 0.331s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:15 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 is being set with open permissions: ugo+rw Sep 28 12:17:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:15 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 Sep 28 12:17:15 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:16 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69" returned: 0 in 0.474s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:16 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.info Sep 28 12:17:16 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:16 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.info" returned: 0 in 0.337s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:16 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.info is being set with open permissions: ugo+rw Sep 28 12:17:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:16 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.info Sep 28 12:17:16 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:16 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.info" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9deb6e8d-d763-43aa-9b0e-a16e1d52267b tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Create snapshot completed successfully Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "cinder-35727558-1b19-4346-bd2d-d156887fdc69-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-35727558-1b19-4346-bd2d-d156887fdc69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "cinder-quobyte-3cab1df1-c332-4fd0-a37b-4b482499b866" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-quobyte-3cab1df1-c332-4fd0-a37b-4b482499b866" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "cinder-quobyte-35727558-1b19-4346-bd2d-d156887fdc69" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-quobyte-35727558-1b19-4346-bd2d-d156887fdc69" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Deleting offline snapshot 35727558-1b19-4346-bd2d-d156887fdc69 of volume 3cab1df1-c332-4fd0-a37b-4b482499b866 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] snapshot_file for this snap is: volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9b275d-0f54-4c4f-9e35-8965107fbb49]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:18 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 Sep 28 12:17:18 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:18 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69" returned: 0 in 0.417s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cab1df1-c332-4fd0-a37b-4b482499b866(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:17:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0ad32e-74a2-49f8-a373-b4ee38a871ed]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:18 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 Sep 28 12:17:18 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:18 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866" returned: 0 in 0.507s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:18 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 Sep 28 12:17:18 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:19 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69" returned: 0 in 0.438s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:19 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69 Sep 28 12:17:19 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:19 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866.35727558-1b19-4346-bd2d-d156887fdc69" returned: 0 in 0.379s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-quobyte-35727558-1b19-4346-bd2d-d156887fdc69" released by "_delete_snapshot" :: held 1.924s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-quobyte-3cab1df1-c332-4fd0-a37b-4b482499b866" released by "delete_snapshot" :: held 1.953s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Created reservations ['ca3a7745-91e3-4dec-9e3a-f77b2da6e858', '5ac2ab06-1cc3-4d21-8d03-3912ddaee729', '514d7661-f8cd-48e0-8f36-5b66d8d5c3a7', '98e0e830-fffa-488a-8d6f-857427420925'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Delete snapshot completed successfully. Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b165eeaf-2a0e-4d5d-9f37-488f199b3802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-35727558-1b19-4346-bd2d-d156887fdc69-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Flow 'volume_create_manager' (8178e087-4493-4375-8d89-b18d99db6edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948d3730-8fe9-45a7-b54c-d9e38ae04762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948d3730-8fe9-45a7-b54c-d9e38ae04762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1880731567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84003a8e-b0c3-4620-b015-04994d275156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfb5bcc4e30402a9ea098e828c64ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:20Z,use_quota=True,user_id='9670c520b48f4306a153738ba60be13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d4c4d7-b2a0-47a1-bdc5-e4ac771c9a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d4c4d7-b2a0-47a1-bdc5-e4ac771c9a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc937505-1754-45be-9415-b26137224196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc937505-1754-45be-9415-b26137224196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84003a8e-b0c3-4620-b015-04994d275156', 'volume_name': 'volume-84003a8e-b0c3-4620-b015-04994d275156', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8f71e4-692f-47a2-91ba-1e8ffdbb86a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8f71e4-692f-47a2-91ba-1e8ffdbb86a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb8c933-0c1d-4883-b1a5-712b456ef04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Volume 84003a8e-b0c3-4620-b015-04994d275156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84003a8e-b0c3-4620-b015-04994d275156', 'volume_size': 1} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1880731567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84003a8e-b0c3-4620-b015-04994d275156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfb5bcc4e30402a9ea098e828c64ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:20Z,use_quota=True,user_id='9670c520b48f4306a153738ba60be13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Creating volume 84003a8e-b0c3-4620-b015-04994d275156 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:20 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:20 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 1073741824 Sep 28 12:17:20 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:21 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 1073741824" returned: 0 in 0.610s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "cinder-3cab1df1-c332-4fd0-a37b-4b482499b866-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-3cab1df1-c332-4fd0-a37b-4b482499b866-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:21 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 Sep 28 12:17:21 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "cinder-quobyte-3cab1df1-c332-4fd0-a37b-4b482499b866" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-quobyte-3cab1df1-c332-4fd0-a37b-4b482499b866" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a6e3e5-665c-4797-838c-4cff24119a8a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:21 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 Sep 28 12:17:21 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:21 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb8c933-0c1d-4883-b1a5-712b456ef04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84003a8e-b0c3-4620-b015-04994d275156', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bba80e-ea2e-443e-b67d-a352ab1d5ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Volume volume-84003a8e-b0c3-4620-b015-04994d275156 (84003a8e-b0c3-4620-b015-04994d275156): created successfully Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bba80e-ea2e-443e-b67d-a352ab1d5ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Flow 'volume_create_manager' (8178e087-4493-4375-8d89-b18d99db6edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-86613edb-88cf-43d2-af6c-23ec499dfb3a tempest-AttachVolumeTestJSON-309856177 None] Created volume successfully. Sep 28 12:17:21 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866" returned: 0 in 0.429s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:21 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866 Sep 28 12:17:21 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (2d6eabb7-6e4b-4fa2-8cb2-3aebcb642595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584a7fdf-1ac6-4cb2-a683-ea11e73e99f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584a7fdf-1ac6-4cb2-a683-ea11e73e99f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994566116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fa982c-b63a-425b-9d4d-ae7791ae4c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:22Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7534b22d-461e-4ed5-b9d2-3236d0fedfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7534b22d-461e-4ed5-b9d2-3236d0fedfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f111431-b483-4b04-be94-dc08aba93e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f111431-b483-4b04-be94-dc08aba93e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fa982c-b63a-425b-9d4d-ae7791ae4c24', 'volume_name': 'volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30623f7d-9e67-4170-9855-3181cb82a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30623f7d-9e67-4170-9855-3181cb82a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e90c910-1646-4217-b0d3-fb3693b96cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:22 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume a9fa982c-b63a-425b-9d4d-ae7791ae4c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24', 'volume_size': 1} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994566116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fa982c-b63a-425b-9d4d-ae7791ae4c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:22Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Creating volume a9fa982c-b63a-425b-9d4d-ae7791ae4c24 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:22 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:22 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 1073741824 Sep 28 12:17:22 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:22 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3cab1df1-c332-4fd0-a37b-4b482499b866" returned: 0 in 0.287s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-quobyte-3cab1df1-c332-4fd0-a37b-4b482499b866" released by "delete_volume" :: held 0.795s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Created reservations ['1ef018c1-e4bf-46ce-908e-870e647280d1', '1fa02b2d-c8d0-49eb-ae1a-1ca52cb02432', 'ff386d26-062e-49dc-b7be-2dcf48220e29', '42b02311-b28f-4450-89c1-0163194aa0b6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:22 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:22 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:22 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.290s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Deleted volume successfully. Sep 28 12:17:22 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 1073741824" returned: 0 in 0.534s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c7bcb1e5-466a-44d5-9ecf-e7c8725b20f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1214129571 None] Lock "cinder-3cab1df1-c332-4fd0-a37b-4b482499b866-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:22 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 Sep 28 12:17:22 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:23 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" returned: 0 in 0.377s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e90c910-1646-4217-b0d3-fb3693b96cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a383e80-7161-4d41-b824-2a4105c7e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 (a9fa982c-b63a-425b-9d4d-ae7791ae4c24): created successfully Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a383e80-7161-4d41-b824-2a4105c7e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (2d6eabb7-6e4b-4fa2-8cb2-3aebcb642595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2a10fa1-fee2-4c83-8a47-1c1fd5709fc5 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created volume successfully. Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2788c564-1ab1-49c3-bdb5-933742a597ae req-f8c95e20-9fc8-48fc-a747-0e125ffb3198 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2788c564-1ab1-49c3-bdb5-933742a597ae req-f8c95e20-9fc8-48fc-a747-0e125ffb3198 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2788c564-1ab1-49c3-bdb5-933742a597ae req-f8c95e20-9fc8-48fc-a747-0e125ffb3198 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-2788c564-1ab1-49c3-bdb5-933742a597ae req-f8c95e20-9fc8-48fc-a747-0e125ffb3198 tempest-AttachVolumeTestJSON-309856177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-84003a8e-b0c3-4620-b015-04994d275156', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28cd5ee5-3701-4f03-9c8f-e7924fc29067', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:17:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-2788c564-1ab1-49c3-bdb5-933742a597ae req-f8c95e20-9fc8-48fc-a747-0e125ffb3198 tempest-AttachVolumeTestJSON-309856177 None] attachment_update completed successfully. Sep 28 12:17:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Creating offline snapshot 08c26228-d2b1-42eb-97a7-80008a2c0d56 of volume a9fa982c-b63a-425b-9d4d-ae7791ae4c24 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:17:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fadac7-2cd1-4825-95a5-eb98110aef96]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:24 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 Sep 28 12:17:24 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:25 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" returned: 0 in 0.560s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:25 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 1G Sep 28 12:17:25 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:25 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 1G" returned: 0 in 0.487s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:25 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 Sep 28 12:17:25 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:25 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56" returned: 0 in 0.356s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:25 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 is being set with open permissions: ugo+rw Sep 28 12:17:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:25 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 Sep 28 12:17:25 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:26 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56" returned: 0 in 0.272s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:26 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.info Sep 28 12:17:26 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:26 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.info" returned: 0 in 0.382s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:26 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.info is being set with open permissions: ugo+rw Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:26 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.info Sep 28 12:17:26 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Flow 'volume_create_manager' (ae342129-543f-4dfc-a389-e7f41840cd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705fe1ea-ac48-4205-b5ca-e2273a4a0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705fe1ea-ac48-4205-b5ca-e2273a4a0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-502941468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7c946b-fe98-40ff-86c0-9b406fdf770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfb5bcc4e30402a9ea098e828c64ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:27Z,use_quota=True,user_id='9670c520b48f4306a153738ba60be13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a504123-9cc4-496a-8c4e-9b7de1dd339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a504123-9cc4-496a-8c4e-9b7de1dd339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effc7e47-9cdb-426e-9eb3-3f1b296d75a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effc7e47-9cdb-426e-9eb3-3f1b296d75a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7c946b-fe98-40ff-86c0-9b406fdf770a', 'volume_name': 'volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10f6cd4-8970-4e84-bea6-549d31d12753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10f6cd4-8970-4e84-bea6-549d31d12753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f21c8ac-ef3c-4e0b-8070-8b59bae27b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Volume 6b7c946b-fe98-40ff-86c0-9b406fdf770a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a', 'volume_size': 1} Sep 28 12:17:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:27 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.info" returned: 0 in 0.390s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.604s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.140s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-502941468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7c946b-fe98-40ff-86c0-9b406fdf770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfb5bcc4e30402a9ea098e828c64ac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:27Z,use_quota=True,user_id='9670c520b48f4306a153738ba60be13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Creating volume 6b7c946b-fe98-40ff-86c0-9b406fdf770a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:27 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:27 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a 1073741824 Sep 28 12:17:27 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b30de5e4-bba5-473f-a303-33be2573fd86 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Create snapshot completed successfully Sep 28 12:17:27 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a 1073741824" returned: 0 in 0.566s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:27 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a Sep 28 12:17:27 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:28 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a" returned: 0 in 0.386s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f21c8ac-ef3c-4e0b-8070-8b59bae27b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252219a1-7570-44b3-8004-d39084b61b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Volume volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a (6b7c946b-fe98-40ff-86c0-9b406fdf770a): created successfully Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252219a1-7570-44b3-8004-d39084b61b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Flow 'volume_create_manager' (ae342129-543f-4dfc-a389-e7f41840cd47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-91e1f88e-6ed2-4c9e-a07b-9c6e57697c65 tempest-AttachVolumeTestJSON-309856177 None] Created volume successfully. Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (4e77c0aa-4e78-4fec-9a25-a18823b25ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef56049f-399b-4b53-8e98-535fb8184e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef56049f-399b-4b53-8e98-535fb8184e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-501360912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b6e354-a88d-4daa-8014-3a11b832ca3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:28Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0bc9ec-e1cf-4113-a5d1-17a414f433c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0bc9ec-e1cf-4113-a5d1-17a414f433c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbe0601-e6d7-452e-a13b-2d0f59fb0901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbe0601-e6d7-452e-a13b-2d0f59fb0901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b6e354-a88d-4daa-8014-3a11b832ca3f', 'volume_name': 'volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe700b10-d03c-4166-912e-a31b08cd4edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe700b10-d03c-4166-912e-a31b08cd4edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3582fbfa-1de7-4bd4-b29c-ed649c0e0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume b2b6e354-a88d-4daa-8014-3a11b832ca3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f', 'volume_size': 1} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-501360912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b6e354-a88d-4daa-8014-3a11b832ca3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:28Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Creating volume b2b6e354-a88d-4daa-8014-3a11b832ca3f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:28 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:28 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f 1073741824 Sep 28 12:17:28 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (423eaf45-7ac7-475d-8f8f-0a351086052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf942de-f334-4c0f-ab3f-dd0e6f7d62cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf942de-f334-4c0f-ab3f-dd0e6f7d62cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040397595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81cef31b-662e-48b4-9dd8-aa71e4fffc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:29Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e3aab9-a640-437f-a6f7-c2cc85799deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e3aab9-a640-437f-a6f7-c2cc85799deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27add614-21a5-495d-a64d-b1ea4207fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27add614-21a5-495d-a64d-b1ea4207fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81cef31b-662e-48b4-9dd8-aa71e4fffc73', 'volume_name': 'volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a2ef58-fc78-475c-8872-cdadb78bd44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a2ef58-fc78-475c-8872-cdadb78bd44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbc8739-dfa0-4a4c-9c4f-29fb80a72db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume 81cef31b-662e-48b4-9dd8-aa71e4fffc73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73', 'volume_size': 1} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:29 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f 1073741824" returned: 0 in 0.917s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:29 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f Sep 28 12:17:29 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (b05867c8-8ce5-436c-bbc8-0e6e6dc8e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05af5b2-a3f2-4584-92e0-e99851dc9f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05af5b2-a3f2-4584-92e0-e99851dc9f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34268844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e30bf6b-2853-4714-a716-cc1a168d24be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:30Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae72b09-fb0c-4b2a-9cef-39a1386cad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae72b09-fb0c-4b2a-9cef-39a1386cad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f867f1-fa30-435a-b7a1-02d111792f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f867f1-fa30-435a-b7a1-02d111792f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e30bf6b-2853-4714-a716-cc1a168d24be', 'volume_name': 'volume-2e30bf6b-2853-4714-a716-cc1a168d24be', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547e75cb-4d7f-4ede-a9b1-28dc73553994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547e75cb-4d7f-4ede-a9b1-28dc73553994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071c4400-da0b-482f-8555-8c8e8bd0b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume 2e30bf6b-2853-4714-a716-cc1a168d24be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e30bf6b-2853-4714-a716-cc1a168d24be', 'volume_size': 1} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f" returned: 0 in 0.683s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1040397595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81cef31b-662e-48b4-9dd8-aa71e4fffc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:29Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Creating volume 81cef31b-662e-48b4-9dd8-aa71e4fffc73 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:30 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3582fbfa-1de7-4bd4-b29c-ed649c0e0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 1073741824 Sep 28 12:17:30 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bc782f-3de4-49ea-8eb7-fb3d929a225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f (b2b6e354-a88d-4daa-8014-3a11b832ca3f): created successfully Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bc782f-3de4-49ea-8eb7-fb3d929a225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (4e77c0aa-4e78-4fec-9a25-a18823b25ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b1cc2404-59d7-4806-9c1a-b9bcd6ae4a89 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created volume successfully. Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (2a306034-7293-42f0-a031-eded927d081b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee43397-f0c6-40e3-b63e-bac40f9a35dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee43397-f0c6-40e3-b63e-bac40f9a35dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2084449815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8445f12-148a-4c1b-b00e-0d3d99d90998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:31Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4467ccd-7e6e-45a2-8ed6-f34c218dea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4467ccd-7e6e-45a2-8ed6-f34c218dea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddc712f-cfc7-482b-883f-444c91c4daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fddc712f-cfc7-482b-883f-444c91c4daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8445f12-148a-4c1b-b00e-0d3d99d90998', 'volume_name': 'volume-b8445f12-148a-4c1b-b00e-0d3d99d90998', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea2080a-6ee4-4a65-ad80-fd0a9f7eded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea2080a-6ee4-4a65-ad80-fd0a9f7eded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59db39bf-8dea-41a5-b61f-1cd0cb3504fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:30 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume b8445f12-148a-4c1b-b00e-0d3d99d90998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8445f12-148a-4c1b-b00e-0d3d99d90998', 'volume_size': 1} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-817d47ec-18d7-400e-843c-0b285865cd21 req-47d38bd5-b624-46f0-baef-64fd6793db73 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:31 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 1073741824" returned: 0 in 0.882s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:31 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 Sep 28 12:17:31 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (2f2794f5-aefa-4e5d-a49e-ac1390e79898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b0afce-82dc-4169-b2c4-496bdfbfede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b0afce-82dc-4169-b2c4-496bdfbfede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713063549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e28a3b-948a-4e23-946e-02667c2fb8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:31Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e7de0f-3133-49f0-985a-6b71485d6f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e7de0f-3133-49f0-985a-6b71485d6f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1289f8f8-4ae0-4bfc-b29a-8e12fac56054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1289f8f8-4ae0-4bfc-b29a-8e12fac56054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e28a3b-948a-4e23-946e-02667c2fb8a9', 'volume_name': 'volume-62e28a3b-948a-4e23-946e-02667c2fb8a9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c11b89c-1e8b-4569-9804-7bef5d95a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c11b89c-1e8b-4569-9804-7bef5d95a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27ea203-e06a-4a41-852e-dd2373c72afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume 62e28a3b-948a-4e23-946e-02667c2fb8a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e28a3b-948a-4e23-946e-02667c2fb8a9', 'volume_size': 1} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:31 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73" returned: 0 in 0.445s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.442s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34268844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e30bf6b-2853-4714-a716-cc1a168d24be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:30Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Creating volume 2e30bf6b-2853-4714-a716-cc1a168d24be {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:31 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbc8739-dfa0-4a4c-9c4f-29fb80a72db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653d793a-a122-4e1f-b848-4fe0ab4e941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be 1073741824 Sep 28 12:17:31 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 (81cef31b-662e-48b4-9dd8-aa71e4fffc73): created successfully Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653d793a-a122-4e1f-b848-4fe0ab4e941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (423eaf45-7ac7-475d-8f8f-0a351086052b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7d7fcfee-3b60-4a94-b169-e82235c3baee tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created volume successfully. Sep 28 12:17:32 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be 1073741824" returned: 0 in 0.729s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:32 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be Sep 28 12:17:32 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:32 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be" returned: 0 in 0.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2084449815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8445f12-148a-4c1b-b00e-0d3d99d90998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:31Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Creating volume b8445f12-148a-4c1b-b00e-0d3d99d90998 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:32 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071c4400-da0b-482f-8555-8c8e8bd0b22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e30bf6b-2853-4714-a716-cc1a168d24be', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c871a76-58d2-4dcc-ae73-d5408ba29ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:32 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 1073741824 Sep 28 12:17:32 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume volume-2e30bf6b-2853-4714-a716-cc1a168d24be (2e30bf6b-2853-4714-a716-cc1a168d24be): created successfully Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c871a76-58d2-4dcc-ae73-d5408ba29ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (b05867c8-8ce5-436c-bbc8-0e6e6dc8e55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-eb1c056e-e475-4586-9b04-3c1f561a3425 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created volume successfully. Sep 28 12:17:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-25dfc7ea-33a7-4a65-a337-4f0009aae68f tempest-ServerActionsTestOtherA-175313115 None] Terminate volume connection completed successfully. Sep 28 12:17:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-25dfc7ea-33a7-4a65-a337-4f0009aae68f tempest-ServerActionsTestOtherA-175313115 None] Deleting attachment bcba281a-f1f1-4357-b88f-f4f56a18794f. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "cinder-3196524a-18da-4c1f-8f8a-de065fa505ef-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Lock "cinder-3196524a-18da-4c1f-8f8a-de065fa505ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "cinder-quobyte-3196524a-18da-4c1f-8f8a-de065fa505ef" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Lock "cinder-quobyte-3196524a-18da-4c1f-8f8a-de065fa505ef" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[525d3256-6b3d-4107-b648-2bf98eef6e08]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:33 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 1073741824" returned: 0 in 0.678s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:33 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef Sep 28 12:17:33 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:33 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 Sep 28 12:17:33 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:33 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef" returned: 0 in 0.516s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:33 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef Sep 28 12:17:33 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:33 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998" returned: 0 in 0.405s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-817d47ec-18d7-400e-843c-0b285865cd21 req-47d38bd5-b624-46f0-baef-64fd6793db73 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.947s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59db39bf-8dea-41a5-b61f-1cd0cb3504fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8445f12-148a-4c1b-b00e-0d3d99d90998', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b05eff4-fa24-4c39-97b5-d606ffb889c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-817d47ec-18d7-400e-843c-0b285865cd21 req-47d38bd5-b624-46f0-baef-64fd6793db73 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.443s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713063549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e28a3b-948a-4e23-946e-02667c2fb8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553a1b97e07742668d1487aac4fe0e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:31Z,use_quota=True,user_id='b6de8221939f409597d7c650c3fec3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Creating volume 62e28a3b-948a-4e23-946e-02667c2fb8a9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 (b8445f12-148a-4c1b-b00e-0d3d99d90998): created successfully Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b05eff4-fa24-4c39-97b5-d606ffb889c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:33 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 1073741824 Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (2a306034-7293-42f0-a031-eded927d081b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:33 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-35e741fa-db52-4361-bb14-84ed708373d9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created volume successfully. Sep 28 12:17:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-817d47ec-18d7-400e-843c-0b285865cd21 req-47d38bd5-b624-46f0-baef-64fd6793db73 tempest-AttachVolumeTestJSON-309856177 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5658e5a-3476-4066-b1a7-02c887fff8ee', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:17:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-817d47ec-18d7-400e-843c-0b285865cd21 req-47d38bd5-b624-46f0-baef-64fd6793db73 tempest-AttachVolumeTestJSON-309856177 None] attachment_update completed successfully. Sep 28 12:17:34 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3196524a-18da-4c1f-8f8a-de065fa505ef" returned: 0 in 0.444s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Lock "cinder-quobyte-3196524a-18da-4c1f-8f8a-de065fa505ef" released by "delete_volume" :: held 1.032s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG cinder.quota [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Created reservations ['0b3ffc4e-6cc8-4df1-b648-3c114efb70e7', '5f583d1f-3ad2-4c6c-a967-b2c7e8ad83a3', 'f2e11190-58ea-4de1-a27a-6164bab64a55', '81b8488d-93c4-4079-a25a-5c81421982f9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:34 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:34 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "cinder-bb031878-aad3-468e-8ec9-56bade96dbf4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Lock "cinder-bb031878-aad3-468e-8ec9-56bade96dbf4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "cinder-quobyte-bb031878-aad3-468e-8ec9-56bade96dbf4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Lock "cinder-quobyte-bb031878-aad3-468e-8ec9-56bade96dbf4" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a68e7a-5a9a-4504-930a-de3291000c49]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:34 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 1073741824" returned: 0 in 0.767s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:34 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 Sep 28 12:17:34 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:34 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 Sep 28 12:17:34 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:35 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.624s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.manager [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Deleted volume successfully. Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-c36c3129-ed07-4a03-985a-bac0c49b4c9f req-6261128b-1368-44a6-ae1f-55f3ec3adc58 tempest-ServerActionsTestOtherA-175313115 None] Lock "cinder-3196524a-18da-4c1f-8f8a-de065fa505ef-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:35 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9" returned: 0 in 0.488s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27ea203-e06a-4a41-852e-dd2373c72afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e28a3b-948a-4e23-946e-02667c2fb8a9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3d9f5b-e420-43b5-a564-3695167cca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Volume volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 (62e28a3b-948a-4e23-946e-02667c2fb8a9): created successfully Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3d9f5b-e420-43b5-a564-3695167cca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Flow 'volume_create_manager' (2f2794f5-aefa-4e5d-a49e-ac1390e79898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c9a6e69d-7cba-4b89-8c8b-8b2117f9ebf9 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created volume successfully. Sep 28 12:17:35 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:35 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4 Sep 28 12:17:35 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:35 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb031878-aad3-468e-8ec9-56bade96dbf4" returned: 0 in 0.271s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Lock "cinder-quobyte-bb031878-aad3-468e-8ec9-56bade96dbf4" released by "delete_volume" :: held 1.038s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Created reservations ['17950c0c-2899-4491-abc5-55780ed9b158', '15519f4e-66f8-469b-a5bc-12a5fc4accf4', '7cb96a6e-f4aa-4cc7-bbab-1e3ed2d3df21', '1c7954ce-fb21-4538-a4e1-f4a2a129bf60'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-62e28a3b-948a-4e23-946e-02667c2fb8a9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:35 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:35 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-62e28a3b-948a-4e23-946e-02667c2fb8a9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-quobyte-62e28a3b-948a-4e23-946e-02667c2fb8a9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-62e28a3b-948a-4e23-946e-02667c2fb8a9" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2bf993-c1a1-481c-a3ee-5ada9d7e9ec8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:36 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 Sep 28 12:17:36 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:36 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.303s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Deleted volume successfully. Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3596490e-0c0a-455a-8775-689308c6235d tempest-ServerActionsTestOtherA-175313115 None] Lock "cinder-bb031878-aad3-468e-8ec9-56bade96dbf4-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:36 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9" returned: 0 in 0.422s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:36 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9 Sep 28 12:17:36 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:36 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-62e28a3b-948a-4e23-946e-02667c2fb8a9" returned: 0 in 0.297s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-62e28a3b-948a-4e23-946e-02667c2fb8a9" released by "delete_volume" :: held 0.801s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created reservations ['852f2c96-0be0-46fa-87a6-042f3ab63ab5', '961f1932-5348-43eb-9036-70554c7c9cc2', '5614ad6b-078a-4228-9436-ebf656f8df4b', 'c4596cd0-8839-4483-b02d-3313faa40205'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:36 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:36 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-b8445f12-148a-4c1b-b00e-0d3d99d90998-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-b8445f12-148a-4c1b-b00e-0d3d99d90998-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-quobyte-b8445f12-148a-4c1b-b00e-0d3d99d90998" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-b8445f12-148a-4c1b-b00e-0d3d99d90998" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:37 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.493s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9383163-0260-41c3-80ac-a9f89458c7e8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Deleted volume successfully. Sep 28 12:17:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-26bc4c8f-83fb-4ef7-b1ed-87341747c4f1 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-62e28a3b-948a-4e23-946e-02667c2fb8a9-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:37 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 Sep 28 12:17:37 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-7db7a2be-3786-4a9f-96c9-bdbf32e4d383 req-5741d422-683f-4daf-9d99-ddd5128d8964 tempest-AttachVolumeTestJSON-309856177 None] Terminate volume connection completed successfully. Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-7db7a2be-3786-4a9f-96c9-bdbf32e4d383 req-5741d422-683f-4daf-9d99-ddd5128d8964 tempest-AttachVolumeTestJSON-309856177 None] Deleting attachment 28cd5ee5-3701-4f03-9c8f-e7924fc29067. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:17:38 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998" returned: 0 in 0.714s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:38 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998 Sep 28 12:17:38 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:38 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b8445f12-148a-4c1b-b00e-0d3d99d90998" returned: 0 in 0.485s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-b8445f12-148a-4c1b-b00e-0d3d99d90998" released by "delete_volume" :: held 1.302s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created reservations ['c7c812ea-7f02-4ac7-b8da-0bdbc5798083', 'dceb69a0-593b-4496-9b31-997a35790292', 'e1803c77-3aea-4721-8383-ba64580f3006', '48a0c44d-ebc7-4317-b470-c3773de1a421'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:39 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:39 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:39 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.313s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Deleted volume successfully. Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-056f830a-0b23-43cc-80f3-719c11c6e183 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-b8445f12-148a-4c1b-b00e-0d3d99d90998-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-2e30bf6b-2853-4714-a716-cc1a168d24be-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-2e30bf6b-2853-4714-a716-cc1a168d24be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-quobyte-2e30bf6b-2853-4714-a716-cc1a168d24be" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-2e30bf6b-2853-4714-a716-cc1a168d24be" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5a6fad-36b2-49ba-83aa-69361d1a8f9b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-7432372c-893f-4684-be06-fccb4923fc39 req-1368f85c-6473-477e-a9f1-c100813bccfd tempest-AttachVolumeTestJSON-309856177 None] Terminate volume connection completed successfully. Sep 28 12:17:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-7432372c-893f-4684-be06-fccb4923fc39 req-1368f85c-6473-477e-a9f1-c100813bccfd tempest-AttachVolumeTestJSON-309856177 None] Deleting attachment a5658e5a-3476-4066-b1a7-02c887fff8ee. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:17:39 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be Sep 28 12:17:39 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:40 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be" returned: 0 in 0.580s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:40 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be Sep 28 12:17:40 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:40 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e30bf6b-2853-4714-a716-cc1a168d24be" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-2e30bf6b-2853-4714-a716-cc1a168d24be" released by "delete_volume" :: held 0.978s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created reservations ['ca1a7566-b11a-4875-9cad-302552df1d60', 'd0103e47-4967-4c10-b46b-076775a7e5b3', '5d2825ac-25a7-4159-9892-73874c75f36e', 'ddbbfbb4-33be-4aa8-a936-025004032382'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:40 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:40 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Flow 'volume_create_manager' (ab0b070f-f1a0-4a4b-9a64-0bd5cfeb2bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599f7840-88f2-4bd2-a0e5-c1dbf7fd6e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599f7840-88f2-4bd2-a0e5-c1dbf7fd6e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-662598557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b391f9ce1045e5bad4fda32a507f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:41Z,use_quota=True,user_id='a0c9454841af47ef909af57f3a2352da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3158e3ad-aea2-48b7-a4b0-a10d9515ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3158e3ad-aea2-48b7-a4b0-a10d9515ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc803a8-e22f-4814-83a7-21c3e607adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:17:41 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.335s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Deleted volume successfully. Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f2c265c3-79ae-423a-b822-b210e181d70d tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-2e30bf6b-2853-4714-a716-cc1a168d24be-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc803a8-e22f-4814-83a7-21c3e607adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6', 'volume_name': 'volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29b02cf-88aa-40c3-adbf-bcfe9d01513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29b02cf-88aa-40c3-adbf-bcfe9d01513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e105496-7ffa-4c65-8e92-c47bc19ced54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Volume 2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:17:41 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Trying to clone 2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-81cef31b-662e-48b4-9dd8-aa71e4fffc73-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:17:42 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-81cef31b-662e-48b4-9dd8-aa71e4fffc73-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6a9af-7fbd-4797-b9d5-ecd645a6d21f]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-quobyte-81cef31b-662e-48b4-9dd8-aa71e4fffc73" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-81cef31b-662e-48b4-9dd8-aa71e4fffc73" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eed41e-cdd7-455b-a75d-b2a5a343670d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:42 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD Sep 28 12:17:42 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:42 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 Sep 28 12:17:42 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:42 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a is fetched for user a0c9454841af47ef909af57f3a2352da. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37d17b7-b885-49cb-bb46-435f546696a4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:42 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73" returned: 0 in 0.537s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:42 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73 Sep 28 12:17:42 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:42 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD Sep 28 12:17:42 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:43 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-81cef31b-662e-48b4-9dd8-aa71e4fffc73" returned: 0 in 0.340s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-81cef31b-662e-48b4-9dd8-aa71e4fffc73" released by "delete_volume" :: held 0.944s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:43 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-662598557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b391f9ce1045e5bad4fda32a507f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:41Z,use_quota=True,user_id='a0c9454841af47ef909af57f3a2352da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Creating volume 2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created reservations ['81ba7f92-39a6-4888-93b6-aeb09899187b', 'd38117e6-9a83-49d0-b1fb-337d00253fdb', 'b9001db4-40a5-47ec-b772-f7c84617072c', '6542f523-3224-422b-a304-bf8790649d6a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:43 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 1073741824 Sep 28 12:17:43 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:43 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:43 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:43 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.365s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Deleted volume successfully. Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00df0384-face-45c7-b7f7-028f8fa201f7 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-81cef31b-662e-48b4-9dd8-aa71e4fffc73-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:43 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 1073741824" returned: 0 in 0.666s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:43 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 Sep 28 12:17:43 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:44 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6" returned: 0 in 0.278s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Attempting download of 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume 2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9768a2a-078a-406d-bec8-acc60d92e0ec]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_zfjenx92 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-b2b6e354-a88d-4daa-8014-3a11b832ca3f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-b2b6e354-a88d-4daa-8014-3a11b832ca3f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-quobyte-b2b6e354-a88d-4daa-8014-3a11b832ca3f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-b2b6e354-a88d-4daa-8014-3a11b832ca3f" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:44 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_zfjenx92 Sep 28 12:17:44 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e974a1-f0e3-434f-bf5a-5b2927ff958a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:44 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f Sep 28 12:17:44 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:44 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_zfjenx92" returned: 0 in 0.398s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_zfjenx92 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:44 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_zfjenx92 Sep 28 12:17:44 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:44 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f" returned: 0 in 0.480s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:44 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f Sep 28 12:17:44 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:45 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_zfjenx92" returned: 1 in 0.476s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_zfjenx92' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5dc015-e73d-4250-a5f7-c79506ea6386]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:45 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD Sep 28 12:17:45 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:45 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b2b6e354-a88d-4daa-8014-3a11b832ca3f" returned: 0 in 0.382s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-b2b6e354-a88d-4daa-8014-3a11b832ca3f" released by "delete_volume" :: held 0.908s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created reservations ['909de844-053f-4026-a48e-9a33bd6b2c03', 'dd178ad9-9b2f-4b10-8587-cf1df90b9783', '8b1c20c6-f7b6-4f2b-a73b-fbec37c27f7b', 'eea5debd-aeb4-49ae-b1a7-f512de5561f2'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:45 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:45 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:45 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] 1001d1e1-2632-478f-a3a3-396a6f86ff9a was qcow2, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-08c26228-d2b1-42eb-97a7-80008a2c0d56-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:45 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 Sep 28 12:17:45 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-08c26228-d2b1-42eb-97a7-80008a2c0d56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-quobyte-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-quobyte-08c26228-d2b1-42eb-97a7-80008a2c0d56" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-08c26228-d2b1-42eb-97a7-80008a2c0d56" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Deleting offline snapshot 08c26228-d2b1-42eb-97a7-80008a2c0d56 of volume a9fa982c-b63a-425b-9d4d-ae7791ae4c24 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] snapshot_file for this snap is: volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a8637-1e03-435a-a59f-b140e8d3aa72]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:45 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.318s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Deleted volume successfully. Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0741c3c5-fca6-4e21-9768-2e3d29b23d38 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-b2b6e354-a88d-4daa-8014-3a11b832ca3f-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:45 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 Sep 28 12:17:45 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "cinder-6b7c946b-fe98-40ff-86c0-9b406fdf770a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-6b7c946b-fe98-40ff-86c0-9b406fdf770a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "cinder-quobyte-6b7c946b-fe98-40ff-86c0-9b406fdf770a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-quobyte-6b7c946b-fe98-40ff-86c0-9b406fdf770a" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[51850ed8-0332-43de-81dc-0d831f3910dc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:46 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56" returned: 0 in 0.442s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:17:46 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a Sep 28 12:17:46 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f52850-760f-4fa1-bb24-124a322f5d66]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:46 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 Sep 28 12:17:46 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:46 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a" returned: 0 in 0.607s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:46 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a Sep 28 12:17:46 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:46 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" returned: 0 in 0.618s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:46 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 Sep 28 12:17:46 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:46 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6b7c946b-fe98-40ff-86c0-9b406fdf770a" returned: 0 in 0.347s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-quobyte-6b7c946b-fe98-40ff-86c0-9b406fdf770a" released by "delete_volume" :: held 1.005s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Created reservations ['3b41cdbd-60f8-42fe-9ca5-a428c188dd5c', 'd7473f6a-c5b8-494a-8439-5e630dbb2575', '24f32cc3-8d38-44c2-b28e-22e62092c759', 'ef0937d1-4a71-4186-9375-30e184caefe1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:47 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:47 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:47 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56" returned: 0 in 0.536s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:47 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56 Sep 28 12:17:47 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:47 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.383s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Deleted volume successfully. Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-af1909e8-b3f6-4cd5-b256-366df87c2b4b tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-6b7c946b-fe98-40ff-86c0-9b406fdf770a-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:47 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24.08c26228-d2b1-42eb-97a7-80008a2c0d56" returned: 0 in 0.370s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-08c26228-d2b1-42eb-97a7-80008a2c0d56" released by "_delete_snapshot" :: held 2.181s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" released by "delete_snapshot" :: held 2.217s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created reservations ['c8e2fc43-fbfb-4712-a8a4-210736edfcdf', 'e77469c5-03cf-43aa-89bd-37ba70393d2e', 'a6b089c9-1ad1-4031-800c-c1c4e08d84b0', 'ba190d9c-0dc2-4c39-9c8d-ada6cd5e88b6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Delete snapshot completed successfully. Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ceb0a4e7-5520-45e3-bdce-d6de2a277d01 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-08c26228-d2b1-42eb-97a7-80008a2c0d56-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "cinder-84003a8e-b0c3-4620-b015-04994d275156-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-84003a8e-b0c3-4620-b015-04994d275156-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "cinder-quobyte-84003a8e-b0c3-4620-b015-04994d275156" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:48 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6" returned: 0 in 2.737s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_fpqcpu3udevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:17:48 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Converted 112.00 MB image at 40.91 MB/s Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-quobyte-84003a8e-b0c3-4620-b015-04994d275156" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:48 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 1G Sep 28 12:17:48 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[31390c1a-60c4-41c7-9d8a-69725071cdf1]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:48 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 Sep 28 12:17:48 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:48 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 1G" returned: 0 in 0.361s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Downloaded image 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume 2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a for user a0c9454841af47ef909af57f3a2352da is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Marking volume 2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Copying metadata from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a to 2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Creating volume glance metadata for volume 2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 backed by image 1001d1e1-2632-478f-a3a3-396a6f86ff9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-a9fa982c-b63a-425b-9d4d-ae7791ae4c24-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:48 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156" returned: 0 in 0.516s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e105496-7ffa-4c65-8e92-c47bc19ced54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:48 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156 Sep 28 12:17:48 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac957fa0-08d9-434c-828a-c66ab4c9b0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-a9fa982c-b63a-425b-9d4d-ae7791ae4c24-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Volume volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 (2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6): created successfully Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac957fa0-08d9-434c-828a-c66ab4c9b0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Flow 'volume_create_manager' (ab0b070f-f1a0-4a4b-9a64-0bd5cfeb2bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "cinder-quobyte-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a4dd8a19-fd9b-4bf5-ab89-9e85bf977932 tempest-VolumesImageMetadata-503216529 None] Created volume successfully. Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7635a835-51a6-471c-b73e-0fa3e34a7290]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:49 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 Sep 28 12:17:49 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:49 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-84003a8e-b0c3-4620-b015-04994d275156" returned: 0 in 0.330s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-quobyte-84003a8e-b0c3-4620-b015-04994d275156" released by "delete_volume" :: held 0.903s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Created reservations ['41b35dfb-1acb-49a8-935c-9dd6640e345b', '11f73e21-449e-431c-ab57-813a9af24933', 'fe1c9330-9b9a-43c4-bfe6-c7c35a9b64e1', '7ca3b647-e539-4144-936b-49fb1f0f720d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:49 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:49 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "cinder-5541bc13-b5fe-4435-96b8-64fc9614767e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:49 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:49 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-5541bc13-b5fe-4435-96b8-64fc9614767e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:49 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" returned: 0 in 0.543s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:49 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24 Sep 28 12:17:49 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "cinder-quobyte-5541bc13-b5fe-4435-96b8-64fc9614767e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-quobyte-5541bc13-b5fe-4435-96b8-64fc9614767e" acquired by "delete_volume" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd7fdc9-a7e0-4f60-889e-c34ed370d219]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:49 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.452s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Deleted volume successfully. Sep 28 12:17:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b7bdb95d-acf9-4b41-824e-82da9a93ab39 tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-84003a8e-b0c3-4620-b015-04994d275156-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:50 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.510s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:17:50 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e Sep 28 12:17:50 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:50 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" returned: 0 in 0.519s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-quobyte-a9fa982c-b63a-425b-9d4d-ae7791ae4c24" released by "delete_volume" :: held 1.148s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Created reservations ['c5ebc973-bae9-419c-b68e-b69661b4b18b', '34b0bfd2-6f2e-42f4-9f4b-83aa45e86286', '25685e6b-03cc-4b9e-b06c-19693e1d5abc', '81d09d86-23c9-43f7-b395-fc71b73cdfe3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:50 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:50 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:50 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e" returned: 0 in 0.626s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:50 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e Sep 28 12:17:50 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:50 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.311s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Deleted volume successfully. Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20ebfede-e3e3-48c2-90a8-d2841a7c3b45 tempest-CreateVolumesFromSnapshotTest-1000186142 None] Lock "cinder-a9fa982c-b63a-425b-9d4d-ae7791ae4c24-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:50 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5541bc13-b5fe-4435-96b8-64fc9614767e" returned: 0 in 0.342s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-quobyte-5541bc13-b5fe-4435-96b8-64fc9614767e" released by "delete_volume" :: held 1.052s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Created reservations ['d764e792-3e42-40e6-b5fc-662482adab91', '1fc6d68d-88d8-4032-bb21-9b5c718b0259', 'c9204411-7f7f-41d5-814d-f096e1779639', 'a1eaee93-dee3-462d-b5e5-1c0821090118'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Acquiring lock "cinder-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Lock "cinder-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Acquiring lock "cinder-quobyte-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Lock "cinder-quobyte-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a65094d-406a-4850-bb78-634cb5a9bf4a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:51 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:51 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:51 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 Sep 28 12:17:51 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:51 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Deleted volume successfully. Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4559d30e-27de-4738-a36c-50b15e3c5591 tempest-AttachVolumeTestJSON-309856177 None] Lock "cinder-5541bc13-b5fe-4435-96b8-64fc9614767e-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:51 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6" returned: 0 in 0.435s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:51 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6 Sep 28 12:17:51 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:51 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6" returned: 0 in 0.299s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Lock "cinder-quobyte-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6" released by "delete_volume" :: held 0.803s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Created reservations ['b3e31ca1-e25e-4bbd-8cc2-8df8a326251c', '5bb3d810-df84-494e-a6d0-5da1bffa0d6c', '27b76858-2a66-402b-a591-50093c5ad50c', '3f29d33a-4b86-4cd7-8c3e-95aa9752ed0b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:52 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:17:52 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:52 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.332s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Deleted volume successfully. Sep 28 12:17:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c400eb0-464f-4744-996b-933a2b6df584 tempest-VolumesImageMetadata-503216529 None] Lock "cinder-2e22df79-2bc5-4744-8b0f-4c1e1cc21cc6-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-66e563ab-1478-457f-a2d8-73508e36a257 tempest-GroupSnapshotsV319Test-1711422435 None] Group tempest-GroupSnapshotsV319Test-Group-478952522: creating Sep 28 12:17:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-66e563ab-1478-457f-a2d8-73508e36a257 tempest-GroupSnapshotsV319Test-1711422435 None] Group tempest-GroupSnapshotsV319Test-Group-478952522: created successfully Sep 28 12:17:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-66e563ab-1478-457f-a2d8-73508e36a257 tempest-GroupSnapshotsV319Test-1711422435 None] Create group completed successfully. Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Flow 'volume_create_manager' (253fd8c1-f1a7-490c-8988-c807fcab43e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db59879a-c8ac-4740-8ff3-1f8b325c299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db59879a-c8ac-4740-8ff3-1f8b325c299c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-511336580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b3a4ce8-f00a-40a4-b5a5-b4b9507fe986,host='devstack@QuobyteHD#QuobyteHD',id=65d216b8-6d7a-4750-995d-41950317dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f649ee9734410797cddc1160060b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:56Z,use_quota=True,user_id='2a646d652a204f31b341e3a82cbcfd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4715c023-9a06-41fe-ad53-ee51654a06e9),volume_type_id=4715c023-9a06-41fe-ad53-ee51654a06e9)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62098bd-c49f-4322-b814-45f70fa39dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62098bd-c49f-4322-b814-45f70fa39dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad50cd49-05d9-4788-93e4-6ad9499c2b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad50cd49-05d9-4788-93e4-6ad9499c2b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d216b8-6d7a-4750-995d-41950317dc14', 'volume_name': 'volume-65d216b8-6d7a-4750-995d-41950317dc14', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd57f0f-6d88-4b06-bd64-05df9d7aed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd57f0f-6d88-4b06-bd64-05df9d7aed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200dd37c-f609-4a72-ad52-3f2ae2ba6183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Volume 65d216b8-6d7a-4750-995d-41950317dc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d216b8-6d7a-4750-995d-41950317dc14', 'volume_size': 1} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2b3a4ce8-f00a-40a4-b5a5-b4b9507fe986,created_at=2026-09-28T10:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-511336580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b3a4ce8-f00a-40a4-b5a5-b4b9507fe986,host='devstack@QuobyteHD#QuobyteHD',id=65d216b8-6d7a-4750-995d-41950317dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f649ee9734410797cddc1160060b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:56Z,use_quota=True,user_id='2a646d652a204f31b341e3a82cbcfd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4715c023-9a06-41fe-ad53-ee51654a06e9),volume_type_id=4715c023-9a06-41fe-ad53-ee51654a06e9)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Creating volume 65d216b8-6d7a-4750-995d-41950317dc14 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:56 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:56 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 1073741824 Sep 28 12:17:56 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:56 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 1073741824" returned: 0 in 0.530s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:56 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 Sep 28 12:17:56 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:56 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14" returned: 0 in 0.345s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200dd37c-f609-4a72-ad52-3f2ae2ba6183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d216b8-6d7a-4750-995d-41950317dc14', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b29ff7-9f47-4d74-a9a6-d439c1b18f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Volume volume-65d216b8-6d7a-4750-995d-41950317dc14 (65d216b8-6d7a-4750-995d-41950317dc14): created successfully Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b29ff7-9f47-4d74-a9a6-d439c1b18f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Flow 'volume_create_manager' (253fd8c1-f1a7-490c-8988-c807fcab43e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b9de9938-ec8b-40b1-bd46-2d3841399f64 tempest-GroupSnapshotsV319Test-1711422435 None] Created volume successfully. Sep 28 12:17:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] GroupSnapshot 4c0b7bc5-0a4e-4f60-aa38-140a71a6450c: creating. Sep 28 12:17:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Group snapshot 4c0b7bc5-0a4e-4f60-aa38-140a71a6450c: creating. {{(pid=87167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 12:17:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Creating offline snapshot a012d618-0399-48f5-ac92-f796483fa5d5 of volume 65d216b8-6d7a-4750-995d-41950317dc14 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:17:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aae0f4-42f7-418a-a016-0eb105eca2ad]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:58 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 Sep 28 12:17:58 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Flow 'volume_create_manager' (d612beeb-4876-4f80-8f5f-18877fed0c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97329360-6d47-45ea-ab31-030138f210d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97329360-6d47-45ea-ab31-030138f210d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-561153788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4338704b-2ed8-470d-bb26-7d317ea2dbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5bc0e4dc2a4913bc3d3093d1065653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:59Z,use_quota=True,user_id='9464bbb185e54c1bb39449943610f770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a02106-5fcd-482c-ad58-01b76d4ae5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a02106-5fcd-482c-ad58-01b76d4ae5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee71387-ea32-4c8f-8151-f630e6532ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee71387-ea32-4c8f-8151-f630e6532ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4338704b-2ed8-470d-bb26-7d317ea2dbd8', 'volume_name': 'volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9d2417-73a8-42f3-9b1b-2784e41819ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9d2417-73a8-42f3-9b1b-2784e41819ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859ceee6-449b-4e05-8357-b7ab139ac41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Volume 4338704b-2ed8-470d-bb26-7d317ea2dbd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8', 'volume_size': 1} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:59 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14" returned: 0 in 0.553s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:59 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 1G Sep 28 12:17:59 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:59 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 1G" returned: 0 in 0.588s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d216b8-6d7a-4750-995d-41950317dc14 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:59 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d216b8-6d7a-4750-995d-41950317dc14 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 Sep 28 12:17:59 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:00 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d216b8-6d7a-4750-995d-41950317dc14 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5" returned: 0 in 0.438s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:18:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:00 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 Sep 28 12:18:00 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:00 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5" returned: 0 in 0.294s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:00 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.info Sep 28 12:18:00 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:01 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.info" returned: 0 in 0.352s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:01 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:01 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.info Sep 28 12:18:01 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:01 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.info" returned: 0 in 0.372s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-561153788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4338704b-2ed8-470d-bb26-7d317ea2dbd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5bc0e4dc2a4913bc3d3093d1065653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:59Z,use_quota=True,user_id='9464bbb185e54c1bb39449943610f770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Creating volume 4338704b-2ed8-470d-bb26-7d317ea2dbd8 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:01 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:01 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 1073741824 Sep 28 12:18:01 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-882404f6-c677-4fee-8c8c-863d439a1664 tempest-GroupSnapshotsV319Test-1711422435 None] group_snapshot 4c0b7bc5-0a4e-4f60-aa38-140a71a6450c: created successfully Sep 28 12:18:02 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 1073741824" returned: 0 in 0.696s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:02 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 Sep 28 12:18:02 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] group_snapshot 4c0b7bc5-0a4e-4f60-aa38-140a71a6450c: deleting Sep 28 12:18:02 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8" returned: 0 in 0.453s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859ceee6-449b-4e05-8357-b7ab139ac41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4460a35c-e02a-4520-a835-945e0982dbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] group_snapshot 4c0b7bc5-0a4e-4f60-aa38-140a71a6450c: deleting {{(pid=87167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 12:18:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Volume volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 (4338704b-2ed8-470d-bb26-7d317ea2dbd8): created successfully Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4460a35c-e02a-4520-a835-945e0982dbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Flow 'volume_create_manager' (d612beeb-4876-4f80-8f5f-18877fed0c3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Acquiring lock "cinder-quobyte-65d216b8-6d7a-4750-995d-41950317dc14" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2e94a71e-26af-46c0-b6bf-915d744e7a56 tempest-AbsoluteLimitsTests-1552447353 None] Created volume successfully. Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "cinder-quobyte-65d216b8-6d7a-4750-995d-41950317dc14" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Acquiring lock "cinder-quobyte-a012d618-0399-48f5-ac92-f796483fa5d5" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "cinder-quobyte-a012d618-0399-48f5-ac92-f796483fa5d5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Deleting offline snapshot a012d618-0399-48f5-ac92-f796483fa5d5 of volume 65d216b8-6d7a-4750-995d-41950317dc14 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] snapshot_file for this snap is: volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c020f1b7-4fde-4906-a9af-f31df1bd8d68]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:03 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 Sep 28 12:18:03 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:03 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5" returned: 0 in 0.457s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65d216b8-6d7a-4750-995d-41950317dc14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[590f6683-0e21-4284-b6fb-61cc212a04e4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:03 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 Sep 28 12:18:03 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Acquiring lock "cinder-4338704b-2ed8-470d-bb26-7d317ea2dbd8-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Lock "cinder-4338704b-2ed8-470d-bb26-7d317ea2dbd8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Acquiring lock "cinder-quobyte-4338704b-2ed8-470d-bb26-7d317ea2dbd8" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Lock "cinder-quobyte-4338704b-2ed8-470d-bb26-7d317ea2dbd8" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4879bd8f-7f8f-4051-95dd-7ccdcc324f96]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:04 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14" returned: 0 in 0.601s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:04 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 Sep 28 12:18:04 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:04 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 Sep 28 12:18:04 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Flow 'volume_create_manager' (f4b7468b-6e1e-4988-806f-de025b58ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a443347b-8a92-416d-a442-8b2fb0343ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a443347b-8a92-416d-a442-8b2fb0343ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-346862294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769851b0-e2a6-4cf4-9ef9-a40533403f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe38ab58838945de8284068e38195a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:04Z,use_quota=True,user_id='f268fe4ac90d44dda339928bec57528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b6611d-453c-4b07-be76-32908c71a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b6611d-453c-4b07-be76-32908c71a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c392db-8262-493a-9836-e7fd8ac67b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c392db-8262-493a-9836-e7fd8ac67b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769851b0-e2a6-4cf4-9ef9-a40533403f0d', 'volume_name': 'volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791c8b41-5f58-4ee5-8d16-20c9a7c73fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791c8b41-5f58-4ee5-8d16-20c9a7c73fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50949ee5-b173-4044-bc3b-b20d9d820506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Volume 769851b0-e2a6-4cf4-9ef9-a40533403f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d', 'volume_size': 1} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-346862294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769851b0-e2a6-4cf4-9ef9-a40533403f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe38ab58838945de8284068e38195a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:04Z,use_quota=True,user_id='f268fe4ac90d44dda339928bec57528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Creating volume 769851b0-e2a6-4cf4-9ef9-a40533403f0d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:04 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d 1073741824 Sep 28 12:18:04 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:04 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8" returned: 0 in 0.465s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:04 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8 Sep 28 12:18:04 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:04 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5" returned: 0 in 0.448s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:04 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5 Sep 28 12:18:04 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:04 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4338704b-2ed8-470d-bb26-7d317ea2dbd8" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Lock "cinder-quobyte-4338704b-2ed8-470d-bb26-7d317ea2dbd8" released by "delete_volume" :: held 0.859s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:04 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14.a012d618-0399-48f5-ac92-f796483fa5d5" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "cinder-quobyte-a012d618-0399-48f5-ac92-f796483fa5d5" released by "_delete_snapshot" :: held 2.003s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Lock "cinder-quobyte-65d216b8-6d7a-4750-995d-41950317dc14" released by "delete_snapshot" :: held 2.052s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Created reservations ['8e80a468-fbbb-4f87-b296-60c12047f15e', 'fb302f2a-111a-4342-b233-76f78861946d', '6a2b6cdd-fcf5-4101-bdd1-9959773dfb31', 'cbcb7b60-b66b-4f6c-a5fe-6db10377dc8a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:04 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d 1073741824" returned: 0 in 0.688s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:05 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d Sep 28 12:18:05 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:05 devstack cinder-volume[87167]: WARNING cinder.quota [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-394482142 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-394482142, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:18:05 devstack cinder-volume[87167]: WARNING cinder.quota [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-394482142 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-394482142, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:18:05 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:05 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] Created reservations ['bf4c5ffa-65df-499d-898c-f4eaf1b7c4ca', 'de5dd923-b537-4a09-ae86-96a6f08178f1', '7ae2715b-5939-4bae-a23b-f853dd15e57a', 'bbd6abe9-36b7-4b06-9493-208c95185b09'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:05 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d" returned: 0 in 0.349s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50949ee5-b173-4044-bc3b-b20d9d820506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe30f88a-f9f9-4cbc-9b34-ce7d57b91da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:05 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.353s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:05 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Deleted volume successfully. Sep 28 12:18:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Volume volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d (769851b0-e2a6-4cf4-9ef9-a40533403f0d): created successfully Sep 28 12:18:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe30f88a-f9f9-4cbc-9b34-ce7d57b91da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Flow 'volume_create_manager' (f4b7468b-6e1e-4988-806f-de025b58ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5f32cda3-d12a-40a0-815f-f6e253ae7975 tempest-AbsoluteLimitsTests-1552447353 None] Lock "cinder-4338704b-2ed8-470d-bb26-7d317ea2dbd8-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-78a19860-a613-4593-8ec6-e6977d01f075 tempest-GroupSnapshotsV319Test-1711422435 None] group_snapshot 4c0b7bc5-0a4e-4f60-aa38-140a71a6450c: deleted successfully Sep 28 12:18:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3272def4-e6a8-4a3c-bdfb-b5a9954230d5 tempest-ProjectReaderTests-399378340 None] Created volume successfully. Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Acquiring lock "cinder-769851b0-e2a6-4cf4-9ef9-a40533403f0d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=161,cinder:UPDATE=180,cinder:INSERT=40,cinder:DELETE=15 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=145,cinder:UPDATE=179,cinder:DELETE=14,cinder:INSERT=57 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Acquiring lock "cinder-quobyte-65d216b8-6d7a-4750-995d-41950317dc14" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Lock "cinder-769851b0-e2a6-4cf4-9ef9-a40533403f0d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Lock "cinder-quobyte-65d216b8-6d7a-4750-995d-41950317dc14" acquired by "delete_volume" :: waited 0.044s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[00773f67-56d9-4c5d-99c0-3a7f59af39a7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:12 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 Sep 28 12:18:12 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Acquiring lock "cinder-quobyte-769851b0-e2a6-4cf4-9ef9-a40533403f0d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Lock "cinder-quobyte-769851b0-e2a6-4cf4-9ef9-a40533403f0d" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bdd335-e10a-44bf-a5ac-dc79745c1208]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:12 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d Sep 28 12:18:12 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:12 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14" returned: 0 in 0.452s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:12 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14 Sep 28 12:18:12 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:13 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d" returned: 0 in 0.423s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:13 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65d216b8-6d7a-4750-995d-41950317dc14" returned: 0 in 0.290s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:13 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d Sep 28 12:18:13 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Lock "cinder-quobyte-65d216b8-6d7a-4750-995d-41950317dc14" released by "delete_volume" :: held 0.823s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Created reservations ['5b65b386-2341-4143-8292-04f4249960b4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:13 devstack cinder-volume[87167]: WARNING cinder.quota [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-394482142 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-394482142, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:18:13 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-769851b0-e2a6-4cf4-9ef9-a40533403f0d" returned: 0 in 0.407s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Lock "cinder-quobyte-769851b0-e2a6-4cf4-9ef9-a40533403f0d" released by "delete_volume" :: held 0.893s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Created reservations ['92430d28-2007-4908-b8ba-5fa6b90e02c5', 'f9709562-762b-4a86-920f-d0c78c4e55b8', 'b5edfb6c-3b52-4c24-ab1c-f0d1fe7dd91d', '37098321-3160-46b1-8fff-f80d47b6cd51'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Created reservations ['3c47ea52-47c0-43f2-8dba-8c6580df2c5e', '61284ff0-e448-4d6d-8692-0d945cc6d321', '0ff63a6d-5cc6-4df7-ac9f-399e5df6c5b0', 'f490537a-d695-474e-aaae-7a4aadb4f28a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:13 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:13 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:13 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:13 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:14 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.272s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3af6a25a-31ad-469c-8b00-6b0f0a4a94fd tempest-GroupSnapshotsV319Test-1711422435 None] Delete group completed successfully. Sep 28 12:18:14 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Deleted volume successfully. Sep 28 12:18:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3475f8b0-6232-490c-8a38-35ec2e47c515 tempest-ProjectReaderTests-399378340 None] Lock "cinder-769851b0-e2a6-4cf4-9ef9-a40533403f0d-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Flow 'volume_create_manager' (d6e79fea-79ed-48ec-bd9c-00e405033efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00abd47d-cebc-4be3-848d-6a739f945169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00abd47d-cebc-4be3-848d-6a739f945169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721026466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f1fbdc-2809-49d2-97f1-54f954ade96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe38ab58838945de8284068e38195a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:15Z,use_quota=True,user_id='f268fe4ac90d44dda339928bec57528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72c2a23-002d-4ca5-9fc2-77a44f7984ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72c2a23-002d-4ca5-9fc2-77a44f7984ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042879ef-825a-4a87-8460-cd651a3ea9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042879ef-825a-4a87-8460-cd651a3ea9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f1fbdc-2809-49d2-97f1-54f954ade96b', 'volume_name': 'volume-47f1fbdc-2809-49d2-97f1-54f954ade96b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f03647-4c12-4e28-83fa-6efcee8e5b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f03647-4c12-4e28-83fa-6efcee8e5b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861574d4-0956-4c6b-ae69-0d632e274858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Volume 47f1fbdc-2809-49d2-97f1-54f954ade96b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f1fbdc-2809-49d2-97f1-54f954ade96b', 'volume_size': 1} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721026466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f1fbdc-2809-49d2-97f1-54f954ade96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe38ab58838945de8284068e38195a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:15Z,use_quota=True,user_id='f268fe4ac90d44dda339928bec57528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Creating volume 47f1fbdc-2809-49d2-97f1-54f954ade96b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:15 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:15 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b 1073741824 Sep 28 12:18:15 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:16 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b 1073741824" returned: 0 in 0.777s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:16 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b Sep 28 12:18:16 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:16 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b" returned: 0 in 0.457s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861574d4-0956-4c6b-ae69-0d632e274858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f1fbdc-2809-49d2-97f1-54f954ade96b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39afcc99-9fb2-4670-8c63-b99abcc17e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Volume volume-47f1fbdc-2809-49d2-97f1-54f954ade96b (47f1fbdc-2809-49d2-97f1-54f954ade96b): created successfully Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39afcc99-9fb2-4670-8c63-b99abcc17e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Flow 'volume_create_manager' (d6e79fea-79ed-48ec-bd9c-00e405033efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2a6eeb5a-d7a9-49d1-bc68-2c27205ce0ef tempest-ProjectReaderTests-399378340 None] Created volume successfully. Sep 28 12:18:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Acquiring lock "cinder-47f1fbdc-2809-49d2-97f1-54f954ade96b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Lock "cinder-47f1fbdc-2809-49d2-97f1-54f954ade96b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Acquiring lock "cinder-quobyte-47f1fbdc-2809-49d2-97f1-54f954ade96b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Lock "cinder-quobyte-47f1fbdc-2809-49d2-97f1-54f954ade96b" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[13114d40-44a4-4325-ad44-820d2641d8d9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:17 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b Sep 28 12:18:17 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:18 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b" returned: 0 in 0.443s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:18 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b Sep 28 12:18:18 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:18 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-47f1fbdc-2809-49d2-97f1-54f954ade96b" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Lock "cinder-quobyte-47f1fbdc-2809-49d2-97f1-54f954ade96b" released by "delete_volume" :: held 0.823s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Created reservations ['194be9e4-855a-4a67-93d5-9d6dd19d3162', '53447b04-8a62-4135-9a76-e0589e73e8e7', '7f65aa4e-729b-4269-b48c-24f5d6041216', '147f785f-7e20-4a77-86b6-3e0a03d5eaa7'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:18 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:18 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:19 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.356s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Deleted volume successfully. Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6585423d-17ce-4988-90ec-0e37cd4934a2 tempest-ProjectReaderTests-399378340 None] Lock "cinder-47f1fbdc-2809-49d2-97f1-54f954ade96b-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Flow 'volume_create_manager' (aa676348-0e83-4ff8-8668-68561c328fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed70338-be44-433b-97a1-e849265476e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed70338-be44-433b-97a1-e849265476e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317603887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e47fde1-d669-458b-a57c-35e7d409b0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe38ab58838945de8284068e38195a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:19Z,use_quota=True,user_id='f268fe4ac90d44dda339928bec57528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f8fd13-87b3-46db-befa-752b3936ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f8fd13-87b3-46db-befa-752b3936ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89158c3-cf0e-48b0-89db-2b98ea33794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89158c3-cf0e-48b0-89db-2b98ea33794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e47fde1-d669-458b-a57c-35e7d409b0cb', 'volume_name': 'volume-7e47fde1-d669-458b-a57c-35e7d409b0cb', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50536d3b-0a87-489e-b692-eb111ddfd096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50536d3b-0a87-489e-b692-eb111ddfd096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4666f8-1bf8-4bc7-9c0a-70631e388ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:19 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Volume 7e47fde1-d669-458b-a57c-35e7d409b0cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e47fde1-d669-458b-a57c-35e7d409b0cb', 'volume_size': 1} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317603887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e47fde1-d669-458b-a57c-35e7d409b0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe38ab58838945de8284068e38195a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:19Z,use_quota=True,user_id='f268fe4ac90d44dda339928bec57528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Creating volume 7e47fde1-d669-458b-a57c-35e7d409b0cb {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:19 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:19 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb 1073741824 Sep 28 12:18:19 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:20 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb 1073741824" returned: 0 in 0.812s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:20 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb Sep 28 12:18:20 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:20 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb" returned: 0 in 0.407s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4666f8-1bf8-4bc7-9c0a-70631e388ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e47fde1-d669-458b-a57c-35e7d409b0cb', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49778f46-bb7f-4439-8d6f-ca33db5959a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Volume volume-7e47fde1-d669-458b-a57c-35e7d409b0cb (7e47fde1-d669-458b-a57c-35e7d409b0cb): created successfully Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49778f46-bb7f-4439-8d6f-ca33db5959a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Flow 'volume_create_manager' (aa676348-0e83-4ff8-8668-68561c328fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f678071d-3519-40fc-b77a-20bfa049b96e tempest-ProjectReaderTests-399378340 None] Created volume successfully. Sep 28 12:18:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Acquiring lock "cinder-7e47fde1-d669-458b-a57c-35e7d409b0cb-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Lock "cinder-7e47fde1-d669-458b-a57c-35e7d409b0cb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Acquiring lock "cinder-quobyte-7e47fde1-d669-458b-a57c-35e7d409b0cb" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Lock "cinder-quobyte-7e47fde1-d669-458b-a57c-35e7d409b0cb" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5493fe40-00de-42d3-819e-4823be3df091]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:22 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb Sep 28 12:18:22 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:22 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb" returned: 0 in 0.655s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:22 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb Sep 28 12:18:22 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:23 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7e47fde1-d669-458b-a57c-35e7d409b0cb" returned: 0 in 0.522s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Lock "cinder-quobyte-7e47fde1-d669-458b-a57c-35e7d409b0cb" released by "delete_volume" :: held 1.248s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Created reservations ['8e69cd28-f83d-4e69-b635-4a616ab32919', '4c6dec83-0d13-4a91-b18b-4768da2e448f', '3df9c26d-0952-436d-a023-4f08dbbd1ad3', '76e16b86-8a12-4319-afb7-cb96f4b253c1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:23 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:23 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:23 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.405s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Deleted volume successfully. Sep 28 12:18:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c2dc9f50-f548-45c7-a630-5ed23c31f781 tempest-ProjectReaderTests-399378340 None] Lock "cinder-7e47fde1-d669-458b-a57c-35e7d409b0cb-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Flow 'volume_create_manager' (12fb6275-6045-43ca-9dc7-8937862d32fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f6c5ea-bbb5-485b-a1db-0ba9187b4cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f6c5ea-bbb5-485b-a1db-0ba9187b4cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219199608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a514d12-97dd-4780-aa23-c5341a19fb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe38ab58838945de8284068e38195a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:25Z,use_quota=True,user_id='f268fe4ac90d44dda339928bec57528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe6ea66a-8c5b-4191-b84a-842630779d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe6ea66a-8c5b-4191-b84a-842630779d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b977b717-1912-4412-b290-d828cd866d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b977b717-1912-4412-b290-d828cd866d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a514d12-97dd-4780-aa23-c5341a19fb6e', 'volume_name': 'volume-3a514d12-97dd-4780-aa23-c5341a19fb6e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239bb473-b449-4e84-b612-2e5ad9fded41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239bb473-b449-4e84-b612-2e5ad9fded41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc44f972-c5f7-47d9-a171-90763ebd3359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Volume 3a514d12-97dd-4780-aa23-c5341a19fb6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a514d12-97dd-4780-aa23-c5341a19fb6e', 'volume_size': 1} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219199608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a514d12-97dd-4780-aa23-c5341a19fb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe38ab58838945de8284068e38195a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:25Z,use_quota=True,user_id='f268fe4ac90d44dda339928bec57528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Creating volume 3a514d12-97dd-4780-aa23-c5341a19fb6e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:24 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:24 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e 1073741824 Sep 28 12:18:24 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:25 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e 1073741824" returned: 0 in 0.585s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:25 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e Sep 28 12:18:25 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:25 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e" returned: 0 in 0.367s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc44f972-c5f7-47d9-a171-90763ebd3359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a514d12-97dd-4780-aa23-c5341a19fb6e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c79b83-f851-4276-9488-0bb6d6c5db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Volume volume-3a514d12-97dd-4780-aa23-c5341a19fb6e (3a514d12-97dd-4780-aa23-c5341a19fb6e): created successfully Sep 28 12:18:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c79b83-f851-4276-9488-0bb6d6c5db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Flow 'volume_create_manager' (12fb6275-6045-43ca-9dc7-8937862d32fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2296fd4b-8fd1-4b45-af23-00c9325969e8 tempest-ProjectReaderTests-399378340 None] Created volume successfully. Sep 28 12:18:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Acquiring lock "cinder-3a514d12-97dd-4780-aa23-c5341a19fb6e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Lock "cinder-3a514d12-97dd-4780-aa23-c5341a19fb6e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Acquiring lock "cinder-quobyte-3a514d12-97dd-4780-aa23-c5341a19fb6e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Lock "cinder-quobyte-3a514d12-97dd-4780-aa23-c5341a19fb6e" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ab8b2-8124-4146-9a4a-ba5a2fe4aac2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:27 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e Sep 28 12:18:27 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:27 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e" returned: 0 in 0.516s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:27 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e Sep 28 12:18:27 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:27 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3a514d12-97dd-4780-aa23-c5341a19fb6e" returned: 0 in 0.356s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Lock "cinder-quobyte-3a514d12-97dd-4780-aa23-c5341a19fb6e" released by "delete_volume" :: held 0.965s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Created reservations ['7e3c5172-78c1-449d-9a03-b23b9c22cfc7', '6ee831f4-f5c0-4db0-81a6-d4c7511b8ed7', '5be43102-83b3-40aa-95aa-f0d4bf6dc8bf', '08302cd6-1f6b-49c8-b056-0ee07e87914d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:28 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:28 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Flow 'volume_create_manager' (4a6dbba8-e911-424c-a44c-9e099e75c289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6294a9-7723-4e12-abb3-cc5ea4af9b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6294a9-7723-4e12-abb3-cc5ea4af9b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-23780058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4a4697-ba6a-48de-a368-27d2cd735d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fa539ead1a42358172ac0a9d9f874d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:28Z,use_quota=True,user_id='07eb94ef005f41c3a9da504880afaa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235dbd92-77c8-4c0d-afd0-eaf8a9b4ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235dbd92-77c8-4c0d-afd0-eaf8a9b4ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89282400-6d55-4f80-9dd8-179482cf5a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89282400-6d55-4f80-9dd8-179482cf5a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4a4697-ba6a-48de-a368-27d2cd735d69', 'volume_name': 'volume-da4a4697-ba6a-48de-a368-27d2cd735d69', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f709a508-a0a7-4c49-8772-18897286f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f709a508-a0a7-4c49-8772-18897286f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2001732d-efe8-4528-946c-06ef3481ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Volume da4a4697-ba6a-48de-a368-27d2cd735d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4a4697-ba6a-48de-a368-27d2cd735d69', 'volume_size': 1} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-23780058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4a4697-ba6a-48de-a368-27d2cd735d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fa539ead1a42358172ac0a9d9f874d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:28Z,use_quota=True,user_id='07eb94ef005f41c3a9da504880afaa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Creating volume da4a4697-ba6a-48de-a368-27d2cd735d69 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:28 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:28 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 1073741824 Sep 28 12:18:28 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:28 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.462s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Deleted volume successfully. Sep 28 12:18:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bfb6eabf-573e-4e4c-af1f-2a3fd9be8b96 tempest-ProjectReaderTests-399378340 None] Lock "cinder-3a514d12-97dd-4780-aa23-c5341a19fb6e-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:29 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 1073741824" returned: 0 in 0.801s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:29 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 Sep 28 12:18:29 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:29 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69" returned: 0 in 0.434s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2001732d-efe8-4528-946c-06ef3481ed18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4a4697-ba6a-48de-a368-27d2cd735d69', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2cbbe7-e350-42ed-aa84-b99b71f4d697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:30 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Volume volume-da4a4697-ba6a-48de-a368-27d2cd735d69 (da4a4697-ba6a-48de-a368-27d2cd735d69): created successfully Sep 28 12:18:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2cbbe7-e350-42ed-aa84-b99b71f4d697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Flow 'volume_create_manager' (4a6dbba8-e911-424c-a44c-9e099e75c289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-08f67c10-ba1e-4fc2-aa39-99564156591d tempest-VolumesTransfersV355Test-875553418 None] Created volume successfully. Sep 28 12:18:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-85fdc136-9cf0-4520-9e14-8f008cad2709 tempest-VolumesTransfersV355Test-706392388 None] Transfer volume completed successfully. Sep 28 12:18:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Acquiring lock "cinder-da4a4697-ba6a-48de-a368-27d2cd735d69-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Lock "cinder-da4a4697-ba6a-48de-a368-27d2cd735d69-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Acquiring lock "cinder-quobyte-da4a4697-ba6a-48de-a368-27d2cd735d69" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Lock "cinder-quobyte-da4a4697-ba6a-48de-a368-27d2cd735d69" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3a6392-353c-45d6-975c-4a1dc8037f0d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:33 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 Sep 28 12:18:33 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:34 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69" returned: 0 in 0.748s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:34 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69 Sep 28 12:18:34 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:34 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-da4a4697-ba6a-48de-a368-27d2cd735d69" returned: 0 in 0.357s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Lock "cinder-quobyte-da4a4697-ba6a-48de-a368-27d2cd735d69" released by "delete_volume" :: held 1.188s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Created reservations ['206691ea-a902-4429-b27b-c635dc6754b7', '942fbffc-c9fc-4681-a327-35eb6b0c79cd', '01a7a38d-33d1-4a7a-92df-4702a32cf168', '3490f9fd-7400-45e8-9077-d006a7c79da7'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:34 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:34 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:34 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.287s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:35 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Deleted volume successfully. Sep 28 12:18:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fd9b9f01-af6f-4fb7-bd6d-b18358c9372f tempest-VolumesTransfersV355Test-1457145149 None] Lock "cinder-da4a4697-ba6a-48de-a368-27d2cd735d69-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Flow 'volume_create_manager' (ae224f62-2aae-4fa2-ab23-fb01bb3083cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8d0c95-8896-4826-aa62-7f40620426ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8d0c95-8896-4826-aa62-7f40620426ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1858378903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e76eba-f736-4f09-a2f0-af65312ff99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fa539ead1a42358172ac0a9d9f874d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:36Z,use_quota=True,user_id='07eb94ef005f41c3a9da504880afaa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0855db6-7427-4c4d-ac47-32ca2a419e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0855db6-7427-4c4d-ac47-32ca2a419e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1c133b-1c32-491d-a9ce-7a1dc00314c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1c133b-1c32-491d-a9ce-7a1dc00314c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e76eba-f736-4f09-a2f0-af65312ff99d', 'volume_name': 'volume-b3e76eba-f736-4f09-a2f0-af65312ff99d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0521c8-7408-4001-a269-f9c0138467ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0521c8-7408-4001-a269-f9c0138467ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be64f886-80f7-465c-bdac-bc230db8cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:36 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Volume b3e76eba-f736-4f09-a2f0-af65312ff99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e76eba-f736-4f09-a2f0-af65312ff99d', 'volume_size': 1} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1858378903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e76eba-f736-4f09-a2f0-af65312ff99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fa539ead1a42358172ac0a9d9f874d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:36Z,use_quota=True,user_id='07eb94ef005f41c3a9da504880afaa03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Creating volume b3e76eba-f736-4f09-a2f0-af65312ff99d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:36 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:36 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d 1073741824 Sep 28 12:18:36 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:37 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d 1073741824" returned: 0 in 0.877s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:37 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d Sep 28 12:18:37 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:37 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d" returned: 0 in 0.347s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be64f886-80f7-465c-bdac-bc230db8cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e76eba-f736-4f09-a2f0-af65312ff99d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f3db02-68a6-4340-b4a4-6c42a0296a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:37 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Volume volume-b3e76eba-f736-4f09-a2f0-af65312ff99d (b3e76eba-f736-4f09-a2f0-af65312ff99d): created successfully Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f3db02-68a6-4340-b4a4-6c42a0296a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Flow 'volume_create_manager' (ae224f62-2aae-4fa2-ab23-fb01bb3083cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b48236de-d348-4779-9b51-559b8b0d7ffb tempest-VolumesTransfersV355Test-875553418 None] Created volume successfully. Sep 28 12:18:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6ccf5729-84b2-4e75-ac41-dbd0254d3d16 tempest-GroupsV314Test-981838533 None] Group tempest-GroupsV314Test-Group-1286812289: creating Sep 28 12:18:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6ccf5729-84b2-4e75-ac41-dbd0254d3d16 tempest-GroupsV314Test-981838533 None] Group tempest-GroupsV314Test-Group-1286812289: created successfully Sep 28 12:18:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6ccf5729-84b2-4e75-ac41-dbd0254d3d16 tempest-GroupsV314Test-981838533 None] Create group completed successfully. Sep 28 12:18:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Acquiring lock "cinder-b3e76eba-f736-4f09-a2f0-af65312ff99d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Lock "cinder-b3e76eba-f736-4f09-a2f0-af65312ff99d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Acquiring lock "cinder-quobyte-b3e76eba-f736-4f09-a2f0-af65312ff99d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Lock "cinder-quobyte-b3e76eba-f736-4f09-a2f0-af65312ff99d" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c83d41a-dc8d-4f66-b000-9e2444e62bcb]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:39 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d Sep 28 12:18:39 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:39 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d" returned: 0 in 0.417s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:39 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d Sep 28 12:18:39 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:39 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b3e76eba-f736-4f09-a2f0-af65312ff99d" returned: 0 in 0.299s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Lock "cinder-quobyte-b3e76eba-f736-4f09-a2f0-af65312ff99d" released by "delete_volume" :: held 0.771s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Created reservations ['7c71d008-63b0-44c3-9e8e-4ab4aae2033c', '7947ded6-6655-4de2-9af8-a23639efc0d5', '08cb5fa3-4243-4be3-ac59-c05cbe14ba67', 'b70afc45-ea2d-46ac-b0bc-f30d86c57c1f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:40 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:40 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Flow 'volume_create_manager' (b72b67f4-d42b-4e62-8ff4-478cca1a752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9781624-0eab-4ce3-bf32-c8ccb8f23f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9781624-0eab-4ce3-bf32-c8ccb8f23f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1535015462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7e0a8fa-9ede-482f-9bf5-2e0a9a414cd3,host='devstack@QuobyteHD#QuobyteHD',id=df3e539e-c40c-4479-ad2a-a0639bbb0fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8174382a05124856a8496385a5a677d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:40Z,use_quota=True,user_id='2938b4142bad46b5a7af371fc4c125e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(102110e5-eabe-4554-976b-be25fa177106),volume_type_id=102110e5-eabe-4554-976b-be25fa177106)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6402a5d-db24-450b-bd93-80ab96886ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6402a5d-db24-450b-bd93-80ab96886ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcc9396-8176-4f29-b121-516d4b6e2275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcc9396-8176-4f29-b121-516d4b6e2275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3e539e-c40c-4479-ad2a-a0639bbb0fc9', 'volume_name': 'volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294c667a-8b3a-457d-b704-5ce7f6fd8ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294c667a-8b3a-457d-b704-5ce7f6fd8ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce5ae89-7d28-43f7-be37-206db2fbbf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Volume df3e539e-c40c-4479-ad2a-a0639bbb0fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9', 'volume_size': 1} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b7e0a8fa-9ede-482f-9bf5-2e0a9a414cd3,created_at=2026-09-28T10:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1535015462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7e0a8fa-9ede-482f-9bf5-2e0a9a414cd3,host='devstack@QuobyteHD#QuobyteHD',id=df3e539e-c40c-4479-ad2a-a0639bbb0fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8174382a05124856a8496385a5a677d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:40Z,use_quota=True,user_id='2938b4142bad46b5a7af371fc4c125e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(102110e5-eabe-4554-976b-be25fa177106),volume_type_id=102110e5-eabe-4554-976b-be25fa177106)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Creating volume df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:40 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 1073741824 Sep 28 12:18:40 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:40 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.342s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Deleted volume successfully. Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8c014a3a-86e0-4fc0-ab63-987b9e69ce53 tempest-VolumesTransfersV355Test-1457145149 None] Lock "cinder-b3e76eba-f736-4f09-a2f0-af65312ff99d-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:40 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 1073741824" returned: 0 in 0.570s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:40 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 Sep 28 12:18:40 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:41 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" returned: 0 in 0.302s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce5ae89-7d28-43f7-be37-206db2fbbf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12d49e1-b268-4053-8a7d-1e50ebc7034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Volume volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 (df3e539e-c40c-4479-ad2a-a0639bbb0fc9): created successfully Sep 28 12:18:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12d49e1-b268-4053-8a7d-1e50ebc7034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Flow 'volume_create_manager' (b72b67f4-d42b-4e62-8ff4-478cca1a752b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9bf2d124-9550-45db-89ef-454ce1ed9b56 tempest-GroupsV314Test-981838533 None] Created volume successfully. Sep 28 12:18:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Cloning volume df3e539e-c40c-4479-ad2a-a0639bbb0fc9 to volume 42e82f08-2e39-4d1d-84ff-3d14df97f869 Sep 28 12:18:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Creating offline snapshot 48b28242-3255-4d3b-90cb-d2019400eaab of volume df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:18:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0175af-2eea-4929-af3f-302dae672870]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:43 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 Sep 28 12:18:43 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:44 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" returned: 0 in 0.535s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:44 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab 1G Sep 28 12:18:44 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:44 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab 1G" returned: 0 in 0.586s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:44 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab Sep 28 12:18:44 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:45 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab" returned: 0 in 0.440s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:45 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:18:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:45 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab Sep 28 12:18:45 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:45 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab" returned: 0 in 0.281s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:45 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.info Sep 28 12:18:45 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:45 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.info" returned: 0 in 0.349s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:45 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:18:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:45 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.info Sep 28 12:18:45 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:45 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.info" returned: 0 in 0.272s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Acquiring lock "cinder-quobyte-42e82f08-2e39-4d1d-84ff-3d14df97f869" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Lock "cinder-quobyte-42e82f08-2e39-4d1d-84ff-3d14df97f869" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] snapshot: 48b28242-3255-4d3b-90cb-d2019400eaab, volume: 42e82f08-2e39-4d1d-84ff-3d14df97f869, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffe2e62-5948-4695-a010-b680eb31f559]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:46 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab Sep 28 12:18:46 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:46 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab" returned: 0 in 0.430s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c301e6c8-d18a-4e42-8606-20e383fc1b97]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:46 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 Sep 28 12:18:46 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:46 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" returned: 0 in 0.417s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:18:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:47 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 Sep 28 12:18:47 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Flow 'volume_create_manager' (6d1843ea-044a-4a35-b888-8c5bce6a8464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d848bf-6ee9-4d72-9410-430ce2d105b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d848bf-6ee9-4d72-9410-430ce2d105b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1286019831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183c8602-3bec-4e8a-9072-f901cda4ef84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ebc3ba35c994ad0b7a75ef9639edf2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:49Z,use_quota=True,user_id='4781c18c57ee41c698af27a4144a125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25ec3f6-c551-4a9d-a5ec-84875a40db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25ec3f6-c551-4a9d-a5ec-84875a40db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84d7373-a93c-407f-9d26-a709aca854f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84d7373-a93c-407f-9d26-a709aca854f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183c8602-3bec-4e8a-9072-f901cda4ef84', 'volume_name': 'volume-183c8602-3bec-4e8a-9072-f901cda4ef84', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70646fa-f2c6-43b4-8ef8-eaaa8821841a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70646fa-f2c6-43b4-8ef8-eaaa8821841a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdf61b5-8758-4f3e-9af5-fd5af66c9bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Volume 183c8602-3bec-4e8a-9072-f901cda4ef84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183c8602-3bec-4e8a-9072-f901cda4ef84', 'volume_size': 1} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:49 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:49 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:50 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.712s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:50 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:18:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:18:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:18:54 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869" returned: 0 in 7.259s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:18:54 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Converted 1024.00 MB image at 141.04 MB/s Sep 28 12:18:54 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:54 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 Sep 28 12:18:54 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:54 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869" returned: 0 in 0.269s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Lock "cinder-quobyte-42e82f08-2e39-4d1d-84ff-3d14df97f869" released by "_copy_volume_from_snapshot" :: held 8.478s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Acquiring lock "cinder-quobyte-48b28242-3255-4d3b-90cb-d2019400eaab" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Lock "cinder-quobyte-48b28242-3255-4d3b-90cb-d2019400eaab" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Deleting offline snapshot 48b28242-3255-4d3b-90cb-d2019400eaab of volume df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] snapshot_file for this snap is: volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8806a7-911c-4ccd-b593-71eab5c35cbc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:54 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab Sep 28 12:18:54 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:55 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab" returned: 0 in 0.433s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:18:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d303da1a-d62c-45eb-acf7-9fb0c19d0368]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:55 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 Sep 28 12:18:55 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:55 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" returned: 0 in 0.595s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:55 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab Sep 28 12:18:55 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:56 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab" returned: 0 in 0.436s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:56 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab Sep 28 12:18:56 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:56 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9.48b28242-3255-4d3b-90cb-d2019400eaab" returned: 0 in 0.273s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Lock "cinder-quobyte-48b28242-3255-4d3b-90cb-d2019400eaab" released by "_delete_snapshot" :: held 1.853s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.065s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.087s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1286019831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183c8602-3bec-4e8a-9072-f901cda4ef84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ebc3ba35c994ad0b7a75ef9639edf2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:49Z,use_quota=True,user_id='4781c18c57ee41c698af27a4144a125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Creating volume 183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:56 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:18:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:56 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 1073741824 Sep 28 12:18:56 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7ab284fd-6ad1-483a-a09a-8625e9dcd718 tempest-GroupsV314Test-981838533 None] Create group from source-group-b7e0a8fa-9ede-482f-9bf5-2e0a9a414cd3 completed successfully. Sep 28 12:18:57 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 1073741824" returned: 0 in 0.546s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:57 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 Sep 28 12:18:57 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:57 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84" returned: 0 in 0.271s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdf61b5-8758-4f3e-9af5-fd5af66c9bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183c8602-3bec-4e8a-9072-f901cda4ef84', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6faeeac1-be90-49e5-8044-eac8b5348e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Volume volume-183c8602-3bec-4e8a-9072-f901cda4ef84 (183c8602-3bec-4e8a-9072-f901cda4ef84): created successfully Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6faeeac1-be90-49e5-8044-eac8b5348e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Flow 'volume_create_manager' (6d1843ea-044a-4a35-b888-8c5bce6a8464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5bf044d0-8dec-4a95-8c25-991d76a63579 tempest-VolumesCloneTest-236424373 None] Created volume successfully. Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Acquiring lock "cinder-quobyte-42e82f08-2e39-4d1d-84ff-3d14df97f869" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Lock "cinder-quobyte-42e82f08-2e39-4d1d-84ff-3d14df97f869" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e93c480-8d8b-4a2c-bbb8-054c2ea099ab]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:58 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 Sep 28 12:18:58 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Flow 'volume_create_manager' (a8dd8ff1-fc9b-4c0f-bb95-f2f2d70c4f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289ca846-3178-428f-815d-2f9d6cd8f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289ca846-3178-428f-815d-2f9d6cd8f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-752464079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1722af1f-5507-45a1-9b6b-410d845d81ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ebc3ba35c994ad0b7a75ef9639edf2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=183c8602-3bec-4e8a-9072-f901cda4ef84,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:58Z,use_quota=True,user_id='4781c18c57ee41c698af27a4144a125b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a497105-23dc-4651-9aec-4edc78221e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a497105-23dc-4651-9aec-4edc78221e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0f8aea-51d7-4566-9bb6-664b9a91e50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0f8aea-51d7-4566-9bb6-664b9a91e50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1722af1f-5507-45a1-9b6b-410d845d81ad', 'volume_name': 'volume-1722af1f-5507-45a1-9b6b-410d845d81ad', 'volume_size': 2, 'source_volid': '183c8602-3bec-4e8a-9072-f901cda4ef84', 'source_volstatus': 'available'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f4ed29-0417-40c0-9506-00b39c34bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f4ed29-0417-40c0-9506-00b39c34bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2905d93b-2b04-4f5b-8e1d-7af89ad67113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Volume 1722af1f-5507-45a1-9b6b-410d845d81ad: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1722af1f-5507-45a1-9b6b-410d845d81ad', 'volume_size': 2, 'source_volid': '183c8602-3bec-4e8a-9072-f901cda4ef84', 'source_volstatus': 'available'} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:58 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Cloning volume 183c8602-3bec-4e8a-9072-f901cda4ef84 to volume 1722af1f-5507-45a1-9b6b-410d845d81ad Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Creating offline snapshot d390e13d-56f9-48a1-8ef8-574b541d70be of volume 183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b2c0f9-83de-4cf6-a6fc-7e85f847dbeb]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:58 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869" returned: 0 in 0.475s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:58 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869 Sep 28 12:18:58 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:58 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 Sep 28 12:18:58 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:58 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42e82f08-2e39-4d1d-84ff-3d14df97f869" returned: 0 in 0.281s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Lock "cinder-quobyte-42e82f08-2e39-4d1d-84ff-3d14df97f869" released by "delete_volume" :: held 0.851s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:58 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84" returned: 0 in 0.434s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:59 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be 1G Sep 28 12:18:59 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Created reservations ['78f2ee87-1988-40a3-8ab2-96a52f85542d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:59 devstack cinder-volume[87167]: WARNING cinder.quota [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1706133010 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1706133010, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:18:59 devstack cinder-volume[87167]: WARNING cinder.quota [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1706133010 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1706133010, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Created reservations ['dfb1dd80-341b-4409-81e3-e7f59e87b3e8', '4608a638-2d89-4845-9229-8e9aa25c57fb', '185895ca-008f-4ad2-b88d-e8877b54e513', '00289b22-d47b-479c-96fe-28abf1b1a24e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:59 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:18:59 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:59 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.319s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-89a06f6c-3ebd-4a31-98ff-9e8ee575a4cf tempest-GroupsV314Test-981838533 None] Delete group completed successfully. Sep 28 12:18:59 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be 1G" returned: 0 in 0.543s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183c8602-3bec-4e8a-9072-f901cda4ef84 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:59 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183c8602-3bec-4e8a-9072-f901cda4ef84 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be Sep 28 12:18:59 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Acquiring lock "cinder-quobyte-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Lock "cinder-quobyte-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[853bcf99-d5fe-4f9e-a564-2cce3276164a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:59 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183c8602-3bec-4e8a-9072-f901cda4ef84 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be" returned: 0 in 0.342s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:59 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be is being set with open permissions: ugo+rw Sep 28 12:18:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:59 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 Sep 28 12:18:59 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:59 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be Sep 28 12:18:59 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:00 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be" returned: 0 in 0.246s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:00 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" returned: 0 in 0.378s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:00 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9 Sep 28 12:19:00 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:00 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.info Sep 28 12:19:00 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:00 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" returned: 0 in 0.258s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Lock "cinder-quobyte-df3e539e-c40c-4479-ad2a-a0639bbb0fc9" released by "delete_volume" :: held 0.721s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:00 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.info" returned: 0 in 0.299s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.info is being set with open permissions: ugo+rw Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:00 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.info Sep 28 12:19:00 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Created reservations ['6c9edd39-adf9-4075-a442-3775e000a433'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Created reservations ['96631268-1ccf-4164-abd3-36dbf3e3df6b', 'b081a1e4-17a4-45bf-bfda-b283c3753678', '91624822-49b4-43c3-b3f8-ecd5c9e89958', '50918153-5837-4fac-9ed7-da4bd46fb043'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:00 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:19:00 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:00 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.info" returned: 0 in 0.277s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Acquiring lock "cinder-quobyte-1722af1f-5507-45a1-9b6b-410d845d81ad" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Lock "cinder-quobyte-1722af1f-5507-45a1-9b6b-410d845d81ad" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] snapshot: d390e13d-56f9-48a1-8ef8-574b541d70be, volume: 1722af1f-5507-45a1-9b6b-410d845d81ad, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc90738-f456-4e0a-8449-141e13fda169]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:00 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be Sep 28 12:19:00 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:01 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.348s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4264d589-923e-4c4e-ba8e-ac08237ea634 tempest-GroupsV314Test-981838533 None] Delete group completed successfully. Sep 28 12:19:01 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be" returned: 0 in 0.461s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-183c8602-3bec-4e8a-9072-f901cda4ef84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[82db3be9-61da-4d7f-a43e-453da1eb678e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:01 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 Sep 28 12:19:01 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Flow 'volume_create_manager' (59037729-6a9c-4be6-a6dc-f030c086402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3f1caf-7fa3-45f6-8226-105fd9854870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3f1caf-7fa3-45f6-8226-105fd9854870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-468612748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c8af6236264ce3a93a161c32435c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:02Z,use_quota=True,user_id='c1acdc3048e144e7a63632d85c7df59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79043ca8-bfb5-41d3-9f26-1fbc262c3ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79043ca8-bfb5-41d3-9f26-1fbc262c3ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1b45fd-e2bd-4809-855d-a5d65553f056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1b45fd-e2bd-4809-855d-a5d65553f056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a', 'volume_name': 'volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57873f22-74e6-40e5-ada9-f7399801ea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57873f22-74e6-40e5-ada9-f7399801ea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e7746a-7018-4b00-8049-a4961f20c8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Volume 960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a', 'volume_size': 1} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:01 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84" returned: 0 in 0.580s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:19:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:01 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad Sep 28 12:19:01 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:09 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad" returned: 0 in 7.157s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:19:09 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Converted 1024.00 MB image at 143.04 MB/s Sep 28 12:19:09 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad is being set with open permissions: ugo+rw Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:09 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad Sep 28 12:19:09 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:09 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad" returned: 0 in 0.248s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Lock "cinder-quobyte-1722af1f-5507-45a1-9b6b-410d845d81ad" released by "_copy_volume_from_snapshot" :: held 8.554s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Acquiring lock "cinder-quobyte-d390e13d-56f9-48a1-8ef8-574b541d70be" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Lock "cinder-quobyte-d390e13d-56f9-48a1-8ef8-574b541d70be" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Deleting offline snapshot d390e13d-56f9-48a1-8ef8-574b541d70be of volume 183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] snapshot_file for this snap is: volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cc34da-29a7-4251-9a7a-b691aa1965dc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:09 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be Sep 28 12:19:09 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:09 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-183c8602-3bec-4e8a-9072-f901cda4ef84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e7aa5f-a984-4b55-ac99-bb5074c508cf]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:09 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 Sep 28 12:19:09 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:10 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84" returned: 0 in 0.553s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:10 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be Sep 28 12:19:10 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Flow 'volume_create_manager' (3a60fea3-ebef-4d67-9af1-c613f05bb5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274435fd-3e94-46ee-910c-f7da343bf134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274435fd-3e94-46ee-910c-f7da343bf134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1667119595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef64bc2-a79e-4d9e-b0e6-47b81985d42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d848a2bdf754b9bb36dc75dd67d6ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:10Z,use_quota=True,user_id='ea351e5b2afd4cf8806fd59857ac6c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d708d4-d2e1-4fa9-93c7-294c758532fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d708d4-d2e1-4fa9-93c7-294c758532fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc815f0-7280-42df-9ace-0660965a5a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc815f0-7280-42df-9ace-0660965a5a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef64bc2-a79e-4d9e-b0e6-47b81985d42e', 'volume_name': 'volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ac9f3b-d9b2-49bb-842b-f3b092e1fa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ac9f3b-d9b2-49bb-842b-f3b092e1fa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b550a18e-3b39-489d-a962-ad1c6dffe5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:10 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e', 'volume_size': 1} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:10 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be" returned: 0 in 0.370s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:10 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be Sep 28 12:19:10 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:10 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84.d390e13d-56f9-48a1-8ef8-574b541d70be" returned: 0 in 0.242s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Lock "cinder-quobyte-d390e13d-56f9-48a1-8ef8-574b541d70be" released by "_delete_snapshot" :: held 1.626s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.533s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.160s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-468612748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c8af6236264ce3a93a161c32435c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:02Z,use_quota=True,user_id='c1acdc3048e144e7a63632d85c7df59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Creating volume 960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:11 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:11 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a 1073741824 Sep 28 12:19:11 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2905d93b-2b04-4f5b-8e1d-7af89ad67113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1722af1f-5507-45a1-9b6b-410d845d81ad', 'volume_size': 2, 'source_volid': '183c8602-3bec-4e8a-9072-f901cda4ef84', 'source_volstatus': 'available'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c2dc02-39b3-48a6-8c4a-b82e95a54668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Volume volume-1722af1f-5507-45a1-9b6b-410d845d81ad (1722af1f-5507-45a1-9b6b-410d845d81ad): created successfully Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c2dc02-39b3-48a6-8c4a-b82e95a54668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Flow 'volume_create_manager' (a8dd8ff1-fc9b-4c0f-bb95-f2f2d70c4f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-12bffde6-cc3e-420a-ae85-a2598a048f3b tempest-VolumesCloneTest-236424373 None] Created volume successfully. Sep 28 12:19:11 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a 1073741824" returned: 0 in 0.518s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:11 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a Sep 28 12:19:11 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Acquiring lock "cinder-1722af1f-5507-45a1-9b6b-410d845d81ad-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Lock "cinder-1722af1f-5507-45a1-9b6b-410d845d81ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:11 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a" returned: 0 in 0.313s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1667119595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef64bc2-a79e-4d9e-b0e6-47b81985d42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d848a2bdf754b9bb36dc75dd67d6ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:10Z,use_quota=True,user_id='ea351e5b2afd4cf8806fd59857ac6c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Creating volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:11 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:11 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e 1073741824 Sep 28 12:19:11 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e7746a-7018-4b00-8049-a4961f20c8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d498569-3587-4e40-9a44-11d10caaa285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Volume volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a (960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a): created successfully Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d498569-3587-4e40-9a44-11d10caaa285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Flow 'volume_create_manager' (59037729-6a9c-4be6-a6dc-f030c086402b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Acquiring lock "cinder-quobyte-1722af1f-5507-45a1-9b6b-410d845d81ad" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b40918c7-5237-4b83-9526-d09e1fc74dc8 tempest-AttachVolumeNegativeTest-434635671 None] Created volume successfully. Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Lock "cinder-quobyte-1722af1f-5507-45a1-9b6b-410d845d81ad" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5024dd79-0a00-4e8d-89a0-fc6b32cd1a35]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:12 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad Sep 28 12:19:12 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:12 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e 1073741824" returned: 0 in 0.513s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:12 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad" returned: 0 in 0.429s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:12 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e Sep 28 12:19:12 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:12 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad Sep 28 12:19:12 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:12 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" returned: 0 in 0.310s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:12 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1722af1f-5507-45a1-9b6b-410d845d81ad" returned: 0 in 0.326s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Lock "cinder-quobyte-1722af1f-5507-45a1-9b6b-410d845d81ad" released by "delete_volume" :: held 0.801s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b550a18e-3b39-489d-a962-ad1c6dffe5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f08be7-256e-47c5-9b3d-1778a7920b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Volume volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e (cef64bc2-a79e-4d9e-b0e6-47b81985d42e): created successfully Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f08be7-256e-47c5-9b3d-1778a7920b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Flow 'volume_create_manager' (3a60fea3-ebef-4d67-9af1-c613f05bb5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6010414d-7415-4651-bd54-8d80ab0fecb6 tempest-SnapshotsActionsTest-662126915 None] Created volume successfully. Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Created reservations ['c98d9ebb-e0e5-4f71-ba88-905394f740aa', '4c631fa9-6064-4cb2-83ba-e8583ef5e78a', '8745c007-5437-4350-ac62-6da96d508c87', '922e0ff6-209c-4e75-8d69-99f8884c3621'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:13 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:19:13 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:13 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.323s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Deleted volume successfully. Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=91,cinder:UPDATE=124,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-94f14aef-1241-49fc-8926-64e263bf8a2b tempest-VolumesCloneTest-236424373 None] Lock "cinder-1722af1f-5507-45a1-9b6b-410d845d81ad-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=92,cinder:INSERT=29,cinder:UPDATE=126,cinder:DELETE=8 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Creating offline snapshot cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db5ca0f-436c-45db-aaca-98c32cdbd2ce]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:14 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e Sep 28 12:19:14 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Acquiring lock "cinder-183c8602-3bec-4e8a-9072-f901cda4ef84-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Lock "cinder-183c8602-3bec-4e8a-9072-f901cda4ef84-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-df2ef066-14e4-46be-a0d5-58ca80fd7347 req-d00809e8-cc51-4355-84b6-7fb2cbaba1be tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Acquiring lock "cinder-quobyte-183c8602-3bec-4e8a-9072-f901cda4ef84" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Lock "cinder-quobyte-183c8602-3bec-4e8a-9072-f901cda4ef84" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b3f0f-7713-47d6-9a63-adeecadabbb2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:14 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" returned: 0 in 0.467s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:14 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 1G Sep 28 12:19:14 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:14 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 Sep 28 12:19:14 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:14 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84" returned: 0 in 0.447s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:14 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84 Sep 28 12:19:14 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:14 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 1G" returned: 0 in 0.506s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:15 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:15 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:15 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-183c8602-3bec-4e8a-9072-f901cda4ef84" returned: 0 in 0.311s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Lock "cinder-quobyte-183c8602-3bec-4e8a-9072-f901cda4ef84" released by "delete_volume" :: held 0.836s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Created reservations ['4b24a7f9-9fd7-4ebf-a6fe-ad71f3c87c0e', 'e07a53f7-fe90-4040-93fc-f9893567c6e5', '72240a28-47a7-455d-a42a-a3ad375bab0f', '7e629efc-a7a3-45c5-9613-e233065cdb2a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:15 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.355s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:15 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 is being set with open permissions: ugo+rw Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:15 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:15 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:15 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:19:15 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:15 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.277s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:15 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.info Sep 28 12:19:15 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:15 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.352s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Deleted volume successfully. Sep 28 12:19:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0e8879a9-da38-46c4-a74c-828a256a8564 tempest-VolumesCloneTest-236424373 None] Lock "cinder-183c8602-3bec-4e8a-9072-f901cda4ef84-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:15 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.info" returned: 0 in 0.328s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:16 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.info is being set with open permissions: ugo+rw Sep 28 12:19:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:16 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.info Sep 28 12:19:16 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:16 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.info" returned: 0 in 0.270s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.333s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-df2ef066-14e4-46be-a0d5-58ca80fd7347 req-d00809e8-cc51-4355-84b6-7fb2cbaba1be tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.967s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-df2ef066-14e4-46be-a0d5-58ca80fd7347 req-d00809e8-cc51-4355-84b6-7fb2cbaba1be tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b6eba61a-a29d-4cc6-8bde-9b037204ab71 tempest-SnapshotsActionsTest-662126915 None] Create snapshot completed successfully Sep 28 12:19:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-df2ef066-14e4-46be-a0d5-58ca80fd7347 req-d00809e8-cc51-4355-84b6-7fb2cbaba1be tempest-AttachVolumeNegativeTest-434635671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d68eb83-a13d-4cf9-9a1b-1d26996c399f', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:19:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-df2ef066-14e4-46be-a0d5-58ca80fd7347 req-d00809e8-cc51-4355-84b6-7fb2cbaba1be tempest-AttachVolumeNegativeTest-434635671 None] attachment_update completed successfully. Sep 28 12:19:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Creating offline snapshot 558604a8-1a69-4422-88a2-8233b7b4ea89 of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[93016a57-009c-48bc-9409-d7a6ceffc52c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:18 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:18 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:18 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.417s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:18 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 1G Sep 28 12:19:18 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:19 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 1G" returned: 0 in 0.632s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:19 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 Sep 28 12:19:19 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:19 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89" returned: 0 in 0.375s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:19 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 is being set with open permissions: ugo+rw Sep 28 12:19:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:19 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 Sep 28 12:19:19 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:19 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89" returned: 0 in 0.346s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-062b0446-ee7e-49ae-8562-c57930eb832c tempest-SnapshotsActionsTest-662126915 None] Create snapshot completed successfully Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-558604a8-1a69-4422-88a2-8233b7b4ea89-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-558604a8-1a69-4422-88a2-8233b7b4ea89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-quobyte-558604a8-1a69-4422-88a2-8233b7b4ea89" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-558604a8-1a69-4422-88a2-8233b7b4ea89" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Deleting offline snapshot 558604a8-1a69-4422-88a2-8233b7b4ea89 of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] snapshot_file for this snap is: volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[844de522-d9d7-4854-8b77-f95038aac174]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:20 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 Sep 28 12:19:20 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Flow 'volume_create_manager' (99c3c193-9ba9-4b2e-9532-3f9e5a8df1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c7eef4-1b54-44c2-9a24-971c5f23eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c7eef4-1b54-44c2-9a24-971c5f23eef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-883434476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e81919c-16dd-466b-9322-6c4a0f1af4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7143cf6c29bf4e638bb05056f346de8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:20Z,use_quota=True,user_id='ff57321bd5c74151ac3ad219ee837d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341aa99d-3842-4d30-9412-1e8d4435e03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341aa99d-3842-4d30-9412-1e8d4435e03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebb84bb-3318-4339-8423-016d91c2ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:19:20 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89" returned: 0 in 0.478s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebb84bb-3318-4339-8423-016d91c2ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e81919c-16dd-466b-9322-6c4a0f1af4bb', 'volume_name': 'volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bccc3452-0839-4e11-b302-e607a3f925da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bccc3452-0839-4e11-b302-e607a3f925da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2adb92-04b1-4d72-89b8-29079d866f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Volume 6e81919c-16dd-466b-9322-6c4a0f1af4bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Trying to clone 6e81919c-16dd-466b-9322-6c4a0f1af4bb from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[274012c2-ac83-4cbd-97ec-8838e91544f4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:21 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:21 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:19:21 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3bf838-18be-4054-97d9-787a4d691e1f]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:21 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.525s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:21 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 Sep 28 12:19:21 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:21 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD Sep 28 12:19:21 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:21 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a is fetched for user ff57321bd5c74151ac3ad219ee837d3b. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85f68e3-09d4-45ce-a7b0-00face9f9fee]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:22 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89" returned: 0 in 0.509s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:22 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89 Sep 28 12:19:22 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:22 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD Sep 28 12:19:22 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:22 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.558604a8-1a69-4422-88a2-8233b7b4ea89" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:22 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-883434476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e81919c-16dd-466b-9322-6c4a0f1af4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7143cf6c29bf4e638bb05056f346de8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:20Z,use_quota=True,user_id='ff57321bd5c74151ac3ad219ee837d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Creating volume 6e81919c-16dd-466b-9322-6c4a0f1af4bb {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:22 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-558604a8-1a69-4422-88a2-8233b7b4ea89" released by "_delete_snapshot" :: held 2.061s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" released by "delete_snapshot" :: held 2.096s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:22 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb 1073741824 Sep 28 12:19:22 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Created reservations ['a1b03848-62aa-4a8b-b4f9-9ba6a9ab67c1', 'e8865630-c6c8-4a98-8fe6-a69bbc1cbe37', '65c90d40-0cbb-4995-b2a1-a8fdee2f6924', '3176430a-ab3c-46eb-929a-3f77d95d1d7e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Delete snapshot completed successfully. Sep 28 12:19:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-636ec2ac-4ec5-4c65-ab39-48a13a1f652b tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-558604a8-1a69-4422-88a2-8233b7b4ea89-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:23 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb 1073741824" returned: 0 in 0.596s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:23 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb Sep 28 12:19:23 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:23 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Attempting download of 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume 6e81919c-16dd-466b-9322-6c4a0f1af4bb. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e733d06d-5066-43f6-adc4-cf1facc9060f]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_81lr3cao {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:23 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_81lr3cao Sep 28 12:19:23 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:23 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_81lr3cao" returned: 0 in 0.566s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_81lr3cao {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Creating offline snapshot 4196c4bf-7e96-4738-9a1c-7771ef3f8193 of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[de31421a-720e-4ae0-8268-740f426c5cd3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:24 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_81lr3cao Sep 28 12:19:24 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:24 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:24 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:24 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_81lr3cao" returned: 1 in 0.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_81lr3cao' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e30abc1-5a94-4489-aa23-1f0746461c59]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:24 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD Sep 28 12:19:24 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:24 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.438s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:24 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 1G Sep 28 12:19:24 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:24 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] 1001d1e1-2632-478f-a3a3-396a6f86ff9a was qcow2, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:19:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:24 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb Sep 28 12:19:24 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:25 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 1G" returned: 0 in 0.695s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:25 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 Sep 28 12:19:25 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:25 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193" returned: 0 in 0.377s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:25 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 is being set with open permissions: ugo+rw Sep 28 12:19:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:25 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 Sep 28 12:19:25 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:26 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193" returned: 0 in 0.396s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d1a776a0-a7ad-430f-bba6-6848e55b3839 tempest-SnapshotsActionsTest-662126915 None] Create snapshot completed successfully Sep 28 12:19:27 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb" returned: 0 in 2.293s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_3od1a3s4devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:19:27 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Converted 112.00 MB image at 48.83 MB/s Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:27 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb 1G Sep 28 12:19:27 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-4196c4bf-7e96-4738-9a1c-7771ef3f8193-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-4196c4bf-7e96-4738-9a1c-7771ef3f8193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-quobyte-4196c4bf-7e96-4738-9a1c-7771ef3f8193" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-4196c4bf-7e96-4738-9a1c-7771ef3f8193" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Deleting offline snapshot 4196c4bf-7e96-4738-9a1c-7771ef3f8193 of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] snapshot_file for this snap is: volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aac6fc-c50c-4be9-b1c8-38660ff6e7d9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:27 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 Sep 28 12:19:27 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:27 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb 1G" returned: 0 in 0.685s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Downloaded image 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume 6e81919c-16dd-466b-9322-6c4a0f1af4bb successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a for user ff57321bd5c74151ac3ad219ee837d3b is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Marking volume 6e81919c-16dd-466b-9322-6c4a0f1af4bb as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Copying metadata from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a to 6e81919c-16dd-466b-9322-6c4a0f1af4bb. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:19:27 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Creating volume glance metadata for volume 6e81919c-16dd-466b-9322-6c4a0f1af4bb backed by image 1001d1e1-2632-478f-a3a3-396a6f86ff9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2adb92-04b1-4d72-89b8-29079d866f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b41e12-50e7-4284-adab-05a80a615be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Volume volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb (6e81919c-16dd-466b-9322-6c4a0f1af4bb): created successfully Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b41e12-50e7-4284-adab-05a80a615be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Flow 'volume_create_manager' (99c3c193-9ba9-4b2e-9532-3f9e5a8df1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1fb8ad4d-be2b-498c-b851-71497598b3cf tempest-VolumesExtendTest-838239540 None] Created volume successfully. Sep 28 12:19:28 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193" returned: 0 in 0.647s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1155849e-f964-41dc-b04b-fcd7a69f1523]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:28 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:28 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:28 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.419s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:28 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 Sep 28 12:19:28 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:29 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193" returned: 0 in 0.491s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:29 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193 Sep 28 12:19:29 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c13e41-85b6-49bb-8a3a-47e1bf2fa4b3 tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c13e41-85b6-49bb-8a3a-47e1bf2fa4b3 tempest-VolumesExtendTest-838239540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f9f2a-e697-4e93-a00b-e6b36683244b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-69c13e41-85b6-49bb-8a3a-47e1bf2fa4b3 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:29 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.4196c4bf-7e96-4738-9a1c-7771ef3f8193" returned: 0 in 0.315s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-4196c4bf-7e96-4738-9a1c-7771ef3f8193" released by "_delete_snapshot" :: held 2.077s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" released by "delete_snapshot" :: held 2.147s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:29 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb Sep 28 12:19:29 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Created reservations ['0cc92806-93aa-46e5-af04-c97da8d68df7', 'ea8fd5eb-5ad1-429d-a8e8-08c66b641bac', 'da458e1c-4ffa-46fa-adba-cfbb12ad0c4d', '23aaa6bf-94cb-4f30-934e-d30fa6df6289'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Delete snapshot completed successfully. Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bafb0c4c-eae5-45db-8897-1bc0020fd979 tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-4196c4bf-7e96-4738-9a1c-7771ef3f8193-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:29 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-69c13e41-85b6-49bb-8a3a-47e1bf2fa4b3 tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb" returned: 0 in 0.505s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-69c13e41-85b6-49bb-8a3a-47e1bf2fa4b3 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb 2G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-69c13e41-85b6-49bb-8a3a-47e1bf2fa4b3 tempest-VolumesExtendTest-838239540 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb 2G" returned: 0 in 0.130s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-69c13e41-85b6-49bb-8a3a-47e1bf2fa4b3 tempest-VolumesExtendTest-838239540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.682s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-69c13e41-85b6-49bb-8a3a-47e1bf2fa4b3 tempest-VolumesExtendTest-838239540 None] Extend volume completed successfully. Sep 28 12:19:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Acquiring lock "cinder-6e81919c-16dd-466b-9322-6c4a0f1af4bb-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Lock "cinder-6e81919c-16dd-466b-9322-6c4a0f1af4bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Acquiring lock "cinder-quobyte-6e81919c-16dd-466b-9322-6c4a0f1af4bb" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Creating offline snapshot 9b943b14-0fe6-41ce-9caa-87293667d5e8 of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Lock "cinder-quobyte-6e81919c-16dd-466b-9322-6c4a0f1af4bb" acquired by "delete_volume" :: waited 0.090s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e4bb2d-ba61-455e-abca-c7e23c48e64d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb61755-be11-4d7c-9e4e-b3123e998307]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:31 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:31 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:31 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb Sep 28 12:19:31 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:31 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb" returned: 0 in 0.481s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:31 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.540s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:31 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb Sep 28 12:19:31 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:31 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 1G Sep 28 12:19:31 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:32 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6e81919c-16dd-466b-9322-6c4a0f1af4bb" returned: 0 in 0.505s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Lock "cinder-quobyte-6e81919c-16dd-466b-9322-6c4a0f1af4bb" released by "delete_volume" :: held 1.065s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Created reservations ['67c52005-e5d6-45e3-8f69-46903b72cd99', '8267ac83-9b8e-416f-a232-e85ae824d01a', 'b922f268-eb36-405f-b73a-10c50ed7b153', 'f7e0816b-841f-4435-afb0-184c769abf74'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:32 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 1G" returned: 0 in 0.772s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:32 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:19:32 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:32 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 Sep 28 12:19:32 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:32 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Deleted volume successfully. Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8023c884-ea85-4b16-98e7-bdec1943378c tempest-VolumesExtendTest-838239540 None] Lock "cinder-6e81919c-16dd-466b-9322-6c4a0f1af4bb-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:32 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8" returned: 0 in 0.443s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:32 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 is being set with open permissions: ugo+rw Sep 28 12:19:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:32 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 Sep 28 12:19:32 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:33 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8" returned: 0 in 0.339s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.275s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a9df4828-433a-417a-8b76-f9b37207f3ce tempest-SnapshotsActionsTest-662126915 None] Create snapshot completed successfully Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Flow 'volume_create_manager' (487ca94d-4121-4f65-9dec-1d3b909444aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c48f61b-a61a-423d-bcda-910056bcaecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c48f61b-a61a-423d-bcda-910056bcaecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1727271796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7143cf6c29bf4e638bb05056f346de8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:34Z,use_quota=True,user_id='ff57321bd5c74151ac3ad219ee837d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d443342a-ba73-4047-8da6-f7b88a283f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d443342a-ba73-4047-8da6-f7b88a283f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a389637-ea5c-4402-9dc9-33db6d4d120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a389637-ea5c-4402-9dc9-33db6d4d120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7', 'volume_name': 'volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d173fe1-5e0e-42f8-8561-d2fa094fe7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d173fe1-5e0e-42f8-8561-d2fa094fe7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7477506-8b53-4034-bed6-48887b6c007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Volume 49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7', 'volume_size': 1} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1727271796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7143cf6c29bf4e638bb05056f346de8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:34Z,use_quota=True,user_id='ff57321bd5c74151ac3ad219ee837d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Creating volume 49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:19:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:33 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 1073741824 Sep 28 12:19:33 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-9b943b14-0fe6-41ce-9caa-87293667d5e8-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-9b943b14-0fe6-41ce-9caa-87293667d5e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-quobyte-9b943b14-0fe6-41ce-9caa-87293667d5e8" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-9b943b14-0fe6-41ce-9caa-87293667d5e8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Deleting offline snapshot 9b943b14-0fe6-41ce-9caa-87293667d5e8 of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:19:34 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] snapshot_file for this snap is: volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 1073741824" returned: 0 in 0.518s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad0af7e-026e-4fad-a9a1-1662fcc0860e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:34 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 Sep 28 12:19:34 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:34 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 Sep 28 12:19:34 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:34 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" returned: 0 in 0.323s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7477506-8b53-4034-bed6-48887b6c007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8413eb9a-1801-4115-b9f7-3197de2a1d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Volume volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 (49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7): created successfully Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8413eb9a-1801-4115-b9f7-3197de2a1d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Flow 'volume_create_manager' (487ca94d-4121-4f65-9dec-1d3b909444aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:34 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8" returned: 0 in 0.415s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-723ffdb0-33f0-47a1-a24e-ec2700dd4102 tempest-VolumesExtendTest-838239540 None] Created volume successfully. Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c47a74-bf8d-4ef1-a8d0-e5e755a13161]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:35 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:35 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:35 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.383s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:35 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 Sep 28 12:19:35 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:35 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8" returned: 0 in 0.384s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:35 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8 Sep 28 12:19:35 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:35 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.9b943b14-0fe6-41ce-9caa-87293667d5e8" returned: 0 in 0.275s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-9b943b14-0fe6-41ce-9caa-87293667d5e8" released by "_delete_snapshot" :: held 1.602s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" released by "delete_snapshot" :: held 1.628s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Created reservations ['6c878101-84fd-4da3-87f2-4cb1f8e8ebcf', 'bc61371d-7ccb-4e82-aa11-2441a2857a73', '48a8cc85-1fa2-4cd6-bacd-c048c9622332', 'eaec4b27-a463-45e7-8f57-c6c0153a4cfe'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Delete snapshot completed successfully. Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Creating offline snapshot 21bb0ab3-1192-430f-8d7a-bdec43c4377f of volume 49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bdc4139-f12a-432b-8e8b-fd127ded41ba tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-9b943b14-0fe6-41ce-9caa-87293667d5e8-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[59521673-e63d-492a-8268-2aa2f5935ea7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:36 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 Sep 28 12:19:36 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:36 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" returned: 0 in 0.435s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:36 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f 1G Sep 28 12:19:36 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:37 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f 1G" returned: 0 in 0.470s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:37 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f Sep 28 12:19:37 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:37 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f" returned: 0 in 0.302s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:37 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f is being set with open permissions: ugo+rw Sep 28 12:19:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:37 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f Sep 28 12:19:37 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:37 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f" returned: 0 in 0.277s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:37 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.info Sep 28 12:19:37 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:38 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.info" returned: 0 in 0.273s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:38 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.info is being set with open permissions: ugo+rw Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:38 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.info Sep 28 12:19:38 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:38 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.info" returned: 0 in 0.309s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.559s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Creating offline snapshot f0c6d75d-eb23-49b6-b1d7-18867be46b6b of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fb4183b7-b142-4a10-8320-77325f186ee5 tempest-VolumesExtendTest-838239540 None] Create snapshot completed successfully Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f7066d-6494-4bf7-98de-de97f6d445f6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:38 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:38 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:38 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.410s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:38 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b 1G Sep 28 12:19:38 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:39 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b 1G" returned: 0 in 0.516s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:39 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b Sep 28 12:19:39 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0223bf9a-bf94-4b6c-a12a-94da6748d0f3 tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:39 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b" returned: 0 in 0.362s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:39 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b is being set with open permissions: ugo+rw Sep 28 12:19:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:39 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b Sep 28 12:19:39 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:40 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b" returned: 0 in 0.295s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.735s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0223bf9a-bf94-4b6c-a12a-94da6748d0f3 tempest-VolumesExtendTest-838239540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.612s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b5f46d-f580-49e1-9668-110fc1532992]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0223bf9a-bf94-4b6c-a12a-94da6748d0f3 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b9004a03-6109-4b6d-8ade-2b46a274dcab tempest-SnapshotsActionsTest-662126915 None] Create snapshot completed successfully Sep 28 12:19:40 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 Sep 28 12:19:40 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:40 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0223bf9a-bf94-4b6c-a12a-94da6748d0f3 tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" returned: 0 in 0.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0223bf9a-bf94-4b6c-a12a-94da6748d0f3 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f 2G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0223bf9a-bf94-4b6c-a12a-94da6748d0f3 tempest-VolumesExtendTest-838239540 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f 2G" returned: 0 in 0.158s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0223bf9a-bf94-4b6c-a12a-94da6748d0f3 tempest-VolumesExtendTest-838239540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.630s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0223bf9a-bf94-4b6c-a12a-94da6748d0f3 tempest-VolumesExtendTest-838239540 None] Extend volume completed successfully. Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-f0c6d75d-eb23-49b6-b1d7-18867be46b6b-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-f0c6d75d-eb23-49b6-b1d7-18867be46b6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Acquiring lock "cinder-quobyte-f0c6d75d-eb23-49b6-b1d7-18867be46b6b" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-f0c6d75d-eb23-49b6-b1d7-18867be46b6b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Deleting offline snapshot f0c6d75d-eb23-49b6-b1d7-18867be46b6b of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] snapshot_file for this snap is: volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc925626-219e-4c15-a0bb-a4e5aefc0acc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:41 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b Sep 28 12:19:41 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:41 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b" returned: 0 in 0.472s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bffb86-7b06-48f2-a7df-13d39fb087a4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Acquiring lock "cinder-21bb0ab3-1192-430f-8d7a-bdec43c4377f-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:41 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:41 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Lock "cinder-21bb0ab3-1192-430f-8d7a-bdec43c4377f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Acquiring lock "cinder-quobyte-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Lock "cinder-quobyte-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Acquiring lock "cinder-quobyte-21bb0ab3-1192-430f-8d7a-bdec43c4377f" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Lock "cinder-quobyte-21bb0ab3-1192-430f-8d7a-bdec43c4377f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Deleting offline snapshot 21bb0ab3-1192-430f-8d7a-bdec43c4377f of volume 49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] snapshot_file for this snap is: volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8e8d7a-2aa9-4abc-87d2-272551517586]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:42 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f Sep 28 12:19:42 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:42 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.466s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:42 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b Sep 28 12:19:42 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:42 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f" returned: 0 in 0.425s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[70471a45-efc2-4211-88a7-d42c8989bd19]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:42 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 Sep 28 12:19:42 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:42 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b" returned: 0 in 0.511s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:42 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b Sep 28 12:19:42 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:43 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" returned: 0 in 0.486s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:43 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f Sep 28 12:19:43 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:43 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.f0c6d75d-eb23-49b6-b1d7-18867be46b6b" returned: 0 in 0.336s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-f0c6d75d-eb23-49b6-b1d7-18867be46b6b" released by "_delete_snapshot" :: held 1.939s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" released by "delete_snapshot" :: held 1.963s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Created reservations ['6e6808b4-0894-42ec-bab7-dfb449d156ae', '4c9b4bde-070a-4e3d-b946-5ee9eb18af64', 'f485fc6c-7a7e-4abd-bfe0-f02b65395557', 'f6ccde4a-64f1-47b3-abcf-32923eeb7f3d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Delete snapshot completed successfully. Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8e4a9b64-c6f8-40b3-910d-fd01173aee9d tempest-SnapshotsActionsTest-149366883 None] Lock "cinder-f0c6d75d-eb23-49b6-b1d7-18867be46b6b-delete_snapshot" released by "delete_snapshot" :: held 2.147s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:43 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f" returned: 0 in 0.446s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:43 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f Sep 28 12:19:43 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:43 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7.21bb0ab3-1192-430f-8d7a-bdec43c4377f" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Lock "cinder-quobyte-21bb0ab3-1192-430f-8d7a-bdec43c4377f" released by "_delete_snapshot" :: held 1.755s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Lock "cinder-quobyte-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" released by "delete_snapshot" :: held 1.786s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Created reservations ['fe954929-382c-47de-a49f-ddf64c39404a', '01187f5d-a320-464f-aac7-3c26bba04709', '7de0baf6-8677-4731-8b97-e75a5a24dbb3', '72c68b22-196b-4df9-a433-ec2eebc956d0'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Delete snapshot completed successfully. Sep 28 12:19:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-78d71793-2bd9-4aa3-bbbd-e4b3e2cb7adb tempest-VolumesExtendTest-838239540 None] Lock "cinder-21bb0ab3-1192-430f-8d7a-bdec43c4377f-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Acquiring lock "cinder-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Lock "cinder-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Acquiring lock "cinder-quobyte-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Lock "cinder-quobyte-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97cad54-f309-42e3-a078-275bab726719]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:44 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 Sep 28 12:19:44 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:44 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" returned: 0 in 0.422s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:44 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7 Sep 28 12:19:44 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "cinder-cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "cinder-quobyte-cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-quobyte-cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Deleting offline snapshot cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 of volume cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] snapshot_file for this snap is: volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c608725-7033-407a-8dee-3a903ae483ec]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:44 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Lock "cinder-quobyte-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7" released by "delete_volume" :: held 0.760s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Created reservations ['4b465d47-7266-4d99-925a-d7be5f51e5a9', '10fa0165-df2f-438b-a854-4b0449a8bb1f', '3fdcf41d-a469-4315-bdac-8f3ec37fd58e', 'fee182ec-bd2d-47dd-a6ef-747b33247829'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:45 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:45 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:45 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:19:45 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:45 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.443s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceb0a39-f615-4c97-8ef9-bdc26292f27e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:45 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Deleted volume successfully. Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e42ad425-8acb-4f0e-a9da-d190bc31ed61 tempest-VolumesExtendTest-838239540 None] Lock "cinder-49ccaea9-7974-4a9e-9bf4-b9f6c1d3dfd7-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:45 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e Sep 28 12:19:45 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:45 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" returned: 0 in 0.449s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:45 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:45 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:46 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.375s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:46 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0 Sep 28 12:19:46 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:46 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e.cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" returned: 0 in 0.254s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-quobyte-cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0" released by "_delete_snapshot" :: held 1.644s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" released by "delete_snapshot" :: held 1.668s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Created reservations ['e7d0d09b-922c-46dd-91f1-6fa8e67758f1', '5c78a3ff-25c0-4529-86bd-f6c776c4a680', '0ee03d1d-f3b9-4f9a-a9d7-db0196e24304', 'eef99572-3381-454e-aae9-b1974f074257'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Delete snapshot completed successfully. Sep 28 12:19:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-933832a8-af80-408f-a48d-6dd6fdbfbda0 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-cfd75fc1-ce6f-4a0e-a79f-d754bd12e8d0-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "cinder-cef64bc2-a79e-4d9e-b0e6-47b81985d42e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-cef64bc2-a79e-4d9e-b0e6-47b81985d42e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e82bed-3d6c-4f0c-ac07-c704ba489b10]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:47 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e Sep 28 12:19:47 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:47 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" returned: 0 in 0.389s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:47 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e Sep 28 12:19:47 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:47 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" returned: 0 in 0.255s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-quobyte-cef64bc2-a79e-4d9e-b0e6-47b81985d42e" released by "delete_volume" :: held 0.722s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Created reservations ['4bd2fd99-a8c8-497c-bfa0-e225b51c98f9', '38628890-7165-4c99-a3de-3c0236cd4cd3', 'c749f753-76b1-4f63-9412-e21e5ccd3f00', '67358198-9907-44d6-b0f3-478278aba08e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:48 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:19:48 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:48 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.294s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Deleted volume successfully. Sep 28 12:19:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b9edf17c-a168-446e-949a-161f6a021d27 tempest-SnapshotsActionsTest-662126915 None] Lock "cinder-cef64bc2-a79e-4d9e-b0e6-47b81985d42e-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:49 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:19:49 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Flow 'volume_create_manager' (07affe49-1ec9-4359-b498-40a4a568e20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456da1d9-89dc-43d6-ad32-5225f6f520d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456da1d9-89dc-43d6-ad32-5225f6f520d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1578936390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574400a4-a7ac-4630-9627-e483f6a288ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94e4253b8bd4951b420eceae84f9b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:49Z,use_quota=True,user_id='bfd1be73872945a1bbcaf18812541f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad94c56f-72da-4c5a-853d-48f394b9950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad94c56f-72da-4c5a-853d-48f394b9950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f1286d-f864-48b3-92fe-0a19d3bcab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f1286d-f864-48b3-92fe-0a19d3bcab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574400a4-a7ac-4630-9627-e483f6a288ec', 'volume_name': 'volume-574400a4-a7ac-4630-9627-e483f6a288ec', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b4da74-6556-465d-9de8-dd1f53e00c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b4da74-6556-465d-9de8-dd1f53e00c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27655ef0-5a1d-4469-9891-03571fc391d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Volume 574400a4-a7ac-4630-9627-e483f6a288ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574400a4-a7ac-4630-9627-e483f6a288ec', 'volume_size': 1} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1578936390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574400a4-a7ac-4630-9627-e483f6a288ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94e4253b8bd4951b420eceae84f9b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:49Z,use_quota=True,user_id='bfd1be73872945a1bbcaf18812541f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Creating volume 574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:49 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec 1073741824 Sep 28 12:19:49 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:49 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.350s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:19:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:19:50 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec 1073741824" returned: 0 in 0.581s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:50 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec Sep 28 12:19:50 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:50 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec" returned: 0 in 0.280s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27655ef0-5a1d-4469-9891-03571fc391d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574400a4-a7ac-4630-9627-e483f6a288ec', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7268000-c760-41f5-a58a-97d0ee38c7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Volume volume-574400a4-a7ac-4630-9627-e483f6a288ec (574400a4-a7ac-4630-9627-e483f6a288ec): created successfully Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7268000-c760-41f5-a58a-97d0ee38c7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Flow 'volume_create_manager' (07affe49-1ec9-4359-b498-40a4a568e20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0da07e3a-45b0-4b1b-a5a7-d9b54b172ef9 tempest-VolumesSnapshotListTestJSON-666147311 None] Created volume successfully. Sep 28 12:19:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Creating offline snapshot be315cbb-e900-4536-918c-d6ffd06b8449 of volume 574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc812bea-c7d2-4b5f-b470-c0517b6e0294]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:51 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec Sep 28 12:19:51 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:52 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec" returned: 0 in 0.406s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:52 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 1G Sep 28 12:19:52 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:52 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 1G" returned: 0 in 0.477s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:52 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 Sep 28 12:19:52 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:53 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449" returned: 0 in 0.408s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:53 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 is being set with open permissions: ugo+rw Sep 28 12:19:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:53 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 Sep 28 12:19:53 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:53 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:53 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.info Sep 28 12:19:53 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:54 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.info" returned: 0 in 0.632s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:54 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.info is being set with open permissions: ugo+rw Sep 28 12:19:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:54 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.info Sep 28 12:19:54 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:54 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.info" returned: 0 in 0.363s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e3a6bd6f-b154-44c0-8d3c-e697cbcf4f37 tempest-VolumesSnapshotListTestJSON-666147311 None] Create snapshot completed successfully Sep 28 12:19:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Creating offline snapshot 89bfd309-a8bd-4b53-a167-83b714a6abd1 of volume 574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1806fd01-046e-4a17-b124-d28c933ce35c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:55 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 Sep 28 12:19:55 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:55 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449" returned: 0 in 0.512s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574400a4-a7ac-4630-9627-e483f6a288ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:55 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 1G Sep 28 12:19:55 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:56 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 1G" returned: 0 in 0.561s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:56 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 Sep 28 12:19:56 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:56 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1" returned: 0 in 0.376s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:56 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 is being set with open permissions: ugo+rw Sep 28 12:19:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:56 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 Sep 28 12:19:56 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:57 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1" returned: 0 in 0.296s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-76e8162c-41ef-4c37-ad25-a3e083389b36 tempest-VolumesSnapshotListTestJSON-666147311 None] Create snapshot completed successfully Sep 28 12:19:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Creating offline snapshot fe5e1644-eb7c-43fe-9115-cd0708938940 of volume 574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:19:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca37251-faa6-4473-9a64-57305ad17171]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:57 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 Sep 28 12:19:57 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:58 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1" returned: 0 in 0.450s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574400a4-a7ac-4630-9627-e483f6a288ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:58 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 1G Sep 28 12:19:58 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:58 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 1G" returned: 0 in 0.688s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:58 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 Sep 28 12:19:58 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-9eef4c7b-e486-48f0-bcdd-e4851758df9c req-1f4bab69-7a1a-4fed-9c85-16a509690a8f tempest-AttachVolumeNegativeTest-434635671 None] Terminate volume connection completed successfully. Sep 28 12:19:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-9eef4c7b-e486-48f0-bcdd-e4851758df9c req-1f4bab69-7a1a-4fed-9c85-16a509690a8f tempest-AttachVolumeNegativeTest-434635671 None] Deleting attachment 0d68eb83-a13d-4cf9-9a1b-1d26996c399f. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:19:59 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940" returned: 0 in 0.419s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:59 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 is being set with open permissions: ugo+rw Sep 28 12:19:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:59 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 Sep 28 12:19:59 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:59 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940" returned: 0 in 0.315s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f8c81a0d-4b89-4cb2-a7e1-9d99ddb0cbb3 tempest-VolumesSnapshotListTestJSON-666147311 None] Create snapshot completed successfully Sep 28 12:20:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-fe5e1644-eb7c-43fe-9115-cd0708938940-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-fe5e1644-eb7c-43fe-9115-cd0708938940-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-quobyte-fe5e1644-eb7c-43fe-9115-cd0708938940" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-fe5e1644-eb7c-43fe-9115-cd0708938940" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Deleting offline snapshot fe5e1644-eb7c-43fe-9115-cd0708938940 of volume 574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:20:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] snapshot_file for this snap is: volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:20:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec6513f-4503-42f9-9cae-c5504ea270cd]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:02 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 Sep 28 12:20:02 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:02 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940" returned: 0 in 0.499s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574400a4-a7ac-4630-9627-e483f6a288ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f3e958-c8c7-478d-a3e4-c1c77d268a0a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:02 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 Sep 28 12:20:02 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:03 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1" returned: 0 in 0.485s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574400a4-a7ac-4630-9627-e483f6a288ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:03 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 Sep 28 12:20:03 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:03 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940" returned: 0 in 0.529s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:03 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940 Sep 28 12:20:03 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Flow 'volume_create_manager' (04dc15cb-87a4-43e8-b81d-940e06bfdcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6d6776-2182-4315-adc4-5f781fd62d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6d6776-2182-4315-adc4-5f781fd62d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-611490148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c08d5ff-8f6c-497f-840a-960d6bb6a2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79eef3c12cc4bb28935d4c6c87a55be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:04Z,use_quota=True,user_id='aa7394d61179491282ffa9d32c5e3870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c9de46-8287-46ac-9001-f7ed21985b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c9de46-8287-46ac-9001-f7ed21985b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12b32bc-43b5-4773-9f90-b6635bbb23b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12b32bc-43b5-4773-9f90-b6635bbb23b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c08d5ff-8f6c-497f-840a-960d6bb6a2e3', 'volume_name': 'volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4791c28-de05-4b5f-b48e-7f38b402461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4791c28-de05-4b5f-b48e-7f38b402461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cbe2b5-2e46-4cc5-a0b3-2d2a0e7dfda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Volume 2c08d5ff-8f6c-497f-840a-960d6bb6a2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3', 'volume_size': 1} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-611490148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c08d5ff-8f6c-497f-840a-960d6bb6a2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79eef3c12cc4bb28935d4c6c87a55be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:04Z,use_quota=True,user_id='aa7394d61179491282ffa9d32c5e3870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Creating volume 2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:03 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:03 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 1073741824 Sep 28 12:20:03 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:03 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.fe5e1644-eb7c-43fe-9115-cd0708938940" returned: 0 in 0.323s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-fe5e1644-eb7c-43fe-9115-cd0708938940" released by "_delete_snapshot" :: held 1.987s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" released by "delete_snapshot" :: held 2.018s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Created reservations ['70fea38a-7b09-4c0a-9763-24fba52f3000', 'd802ae2b-9a21-4897-b971-1b2c061167e6', '78470bfb-a5a7-4850-b23a-b5d43e9fbea4', '4b574021-d384-4e39-b579-89122062c23a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Delete snapshot completed successfully. Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe2203df-6d45-4ef5-8751-3f07e3dac98f tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-fe5e1644-eb7c-43fe-9115-cd0708938940-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:04 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 1073741824" returned: 0 in 0.533s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:04 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 Sep 28 12:20:04 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:04 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3" returned: 0 in 0.265s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cbe2b5-2e46-4cc5-a0b3-2d2a0e7dfda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3497d01a-9105-4767-b896-f394a7420b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Volume volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 (2c08d5ff-8f6c-497f-840a-960d6bb6a2e3): created successfully Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3497d01a-9105-4767-b896-f394a7420b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Flow 'volume_create_manager' (04dc15cb-87a4-43e8-b81d-940e06bfdcce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6fc9bef4-a7a9-4e90-963f-9df288b1ed82 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Created volume successfully. Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-89bfd309-a8bd-4b53-a167-83b714a6abd1-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-89bfd309-a8bd-4b53-a167-83b714a6abd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-quobyte-89bfd309-a8bd-4b53-a167-83b714a6abd1" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-89bfd309-a8bd-4b53-a167-83b714a6abd1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Deleting offline snapshot 89bfd309-a8bd-4b53-a167-83b714a6abd1 of volume 574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] snapshot_file for this snap is: volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e34843-415f-47dd-9d1a-f607b2d27bf9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:05 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 Sep 28 12:20:05 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:05 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1" returned: 0 in 0.425s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574400a4-a7ac-4630-9627-e483f6a288ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e61f4c5-c0ee-444f-8c1c-332fcbe85cb6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:05 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 Sep 28 12:20:05 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Acquiring lock "cinder-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "cinder-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Acquiring lock "cinder-quobyte-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "cinder-quobyte-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2838d310-321a-4eff-8500-45c0304dbfe3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:06 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 Sep 28 12:20:06 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:06 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449" returned: 0 in 0.461s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574400a4-a7ac-4630-9627-e483f6a288ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:06 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 Sep 28 12:20:06 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:06 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3" returned: 0 in 0.429s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:06 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3 Sep 28 12:20:06 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:06 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1" returned: 0 in 0.523s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:06 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:06 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1 Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3" returned: 0 in 0.303s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:06 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "cinder-quobyte-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3" released by "delete_volume" :: held 0.801s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Created reservations ['b2efeab7-4244-4b89-8ced-9b63fd9a1a60', '90b4eef6-94a6-4982-a6ac-2c845945406c', '962dcf8a-34e4-42d8-a10b-c963cbd36e8f', '3a13547e-1c67-4a99-b32b-8029e5cd756e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:06 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:20:06 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:07 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.89bfd309-a8bd-4b53-a167-83b714a6abd1" returned: 0 in 0.320s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-89bfd309-a8bd-4b53-a167-83b714a6abd1" released by "_delete_snapshot" :: held 1.882s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" released by "delete_snapshot" :: held 1.912s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Created reservations ['a2085bef-bf36-44a4-8b8f-f28c0746f258', '10cc3e48-70ae-490e-ac64-a99c52553c9d', '34174652-c270-48ac-8820-a6c64ce8bc58', '59319602-e769-4739-80c6-736d89da3509'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Delete snapshot completed successfully. Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1443f26e-5218-4f39-a8ff-7d3dd478718d tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-89bfd309-a8bd-4b53-a167-83b714a6abd1-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:07 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.348s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Deleted volume successfully. Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-119827f7-bb52-4489-9abf-0894250338e0 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "cinder-2c08d5ff-8f6c-497f-840a-960d6bb6a2e3-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-be315cbb-e900-4536-918c-d6ffd06b8449-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-be315cbb-e900-4536-918c-d6ffd06b8449-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-quobyte-be315cbb-e900-4536-918c-d6ffd06b8449" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-be315cbb-e900-4536-918c-d6ffd06b8449" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Deleting offline snapshot be315cbb-e900-4536-918c-d6ffd06b8449 of volume 574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] snapshot_file for this snap is: volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f144a30-9b11-45ed-8350-da2a72083f52]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:07 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 Sep 28 12:20:07 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Flow 'volume_create_manager' (ce7d8b99-5e0c-46e4-8184-47706e1bbbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4f350b-2342-4b3f-af8c-61df83467d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4f350b-2342-4b3f-af8c-61df83467d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-401258092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d66a57-14e3-4cc2-9f92-edafc4615608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79eef3c12cc4bb28935d4c6c87a55be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:08Z,use_quota=True,user_id='aa7394d61179491282ffa9d32c5e3870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97960bd6-e2ba-4095-bbb6-9c8e80b378d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97960bd6-e2ba-4095-bbb6-9c8e80b378d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd5c40a-2b65-41dd-bd09-b35588bc13e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd5c40a-2b65-41dd-bd09-b35588bc13e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d66a57-14e3-4cc2-9f92-edafc4615608', 'volume_name': 'volume-d2d66a57-14e3-4cc2-9f92-edafc4615608', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e8cd32-79a3-4b8c-a783-32094eab8106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e8cd32-79a3-4b8c-a783-32094eab8106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb86921-387b-4b7e-9c78-0b62941c3343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Volume d2d66a57-14e3-4cc2-9f92-edafc4615608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d66a57-14e3-4cc2-9f92-edafc4615608', 'volume_size': 1} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-401258092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d66a57-14e3-4cc2-9f92-edafc4615608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79eef3c12cc4bb28935d4c6c87a55be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:08Z,use_quota=True,user_id='aa7394d61179491282ffa9d32c5e3870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Creating volume d2d66a57-14e3-4cc2-9f92-edafc4615608 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:07 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 1073741824 Sep 28 12:20:07 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:07 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449" returned: 0 in 0.485s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574400a4-a7ac-4630-9627-e483f6a288ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c863ce58-45f9-45e5-957f-a82912e2334b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:08 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec Sep 28 12:20:08 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:08 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 1073741824" returned: 0 in 0.581s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:08 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec" returned: 0 in 0.463s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:08 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 Sep 28 12:20:08 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:08 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 Sep 28 12:20:08 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:08 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608" returned: 0 in 0.376s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb86921-387b-4b7e-9c78-0b62941c3343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d66a57-14e3-4cc2-9f92-edafc4615608', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae34858-feac-4cf9-9f54-3d899d728588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Volume volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 (d2d66a57-14e3-4cc2-9f92-edafc4615608): created successfully Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae34858-feac-4cf9-9f54-3d899d728588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Flow 'volume_create_manager' (ce7d8b99-5e0c-46e4-8184-47706e1bbbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5ffafcf2-92e4-48d1-85b3-fb009c09b135 tempest-VolumeQuotasAdminTestJSON-1188640286 None] Created volume successfully. Sep 28 12:20:09 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449" returned: 0 in 0.520s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:09 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449 Sep 28 12:20:09 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:09 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec.be315cbb-e900-4536-918c-d6ffd06b8449" returned: 0 in 0.300s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-be315cbb-e900-4536-918c-d6ffd06b8449" released by "_delete_snapshot" :: held 1.955s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" released by "delete_snapshot" :: held 2.000s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:09 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Created reservations ['a1b83979-dcbf-40cf-8d07-044fd37129b6', '05679eb5-80dc-4806-935c-156f23154561', 'e08b78e4-5d1a-44a1-b53b-ffabe3e08a8f', '8a9b2ae4-1617-423c-8e72-96c8e9e7c4e8'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Delete snapshot completed successfully. Sep 28 12:20:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7bb27844-84fa-43c2-97c7-5040e0218afc tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-be315cbb-e900-4536-918c-d6ffd06b8449-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-574400a4-a7ac-4630-9627-e483f6a288ec-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-23633fc7-c955-493a-93fa-d84a71c010fb tempest-VolumeQuotasAdminTestJSON-1666588635 None] Transfer volume completed successfully. Sep 28 12:20:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-574400a4-a7ac-4630-9627-e483f6a288ec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a789cf3f-482c-4043-8184-3ed2c45d80c4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:10 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec Sep 28 12:20:10 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Acquiring lock "cinder-d2d66a57-14e3-4cc2-9f92-edafc4615608-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Lock "cinder-d2d66a57-14e3-4cc2-9f92-edafc4615608-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:11 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec" returned: 0 in 0.481s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:11 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec Sep 28 12:20:11 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Acquiring lock "cinder-quobyte-d2d66a57-14e3-4cc2-9f92-edafc4615608" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Lock "cinder-quobyte-d2d66a57-14e3-4cc2-9f92-edafc4615608" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[371aaab8-a46b-4af2-9db2-cdd2f04c140b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:11 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 Sep 28 12:20:11 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:11 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-574400a4-a7ac-4630-9627-e483f6a288ec" returned: 0 in 0.374s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-quobyte-574400a4-a7ac-4630-9627-e483f6a288ec" released by "delete_volume" :: held 0.939s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Created reservations ['1abedafb-4346-4830-8ca2-148b86e8284f', '5748b668-9a83-43c1-a7b0-0ffa2e79e42c', '4d397d75-3f7f-49f3-9966-2a663ff15dbb', 'c3dba055-66ed-4df7-8a0a-dc547cc8b478'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:11 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:20:11 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:11 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608" returned: 0 in 0.545s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:12 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608 Sep 28 12:20:12 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:12 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.277s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Deleted volume successfully. Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2def7631-eb45-4e77-b123-c74de28fecf8 tempest-VolumesSnapshotListTestJSON-666147311 None] Lock "cinder-574400a4-a7ac-4630-9627-e483f6a288ec-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:12 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d2d66a57-14e3-4cc2-9f92-edafc4615608" returned: 0 in 0.339s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Lock "cinder-quobyte-d2d66a57-14e3-4cc2-9f92-edafc4615608" released by "delete_volume" :: held 0.950s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Created reservations ['68736f08-958d-48b7-988a-e4a7174b318a', 'a8c5d1c5-0ef0-4aa8-b272-bc8b53836ed4', '76edb88d-b013-47b5-82ea-0cab31e1079e', '4ca06c01-65f0-4ea2-a3e8-c9d07d30baf9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:12 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:20:12 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:13 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.531s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:13 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Deleted volume successfully. Sep 28 12:20:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ec9cd7f-dade-41f5-9c69-783201bf0414 tempest-VolumeQuotasAdminTestJSON-1252072719 None] Lock "cinder-d2d66a57-14e3-4cc2-9f92-edafc4615608-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:22 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=138,cinder:INSERT=51,cinder:UPDATE=135,cinder:DELETE=16 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:20:23 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=127,cinder:UPDATE=142,cinder:INSERT=34,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Flow 'volume_create_manager' (da71006f-3e67-4b63-9ae9-92943f04ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e7b228-592f-40a6-98b3-ff4fdbe144ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e7b228-592f-40a6-98b3-ff4fdbe144ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1321492497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fdb0f4-c37f-4046-908f-fa4ec4ed7d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e4bb902e5f4701bc742002f757869f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:26Z,use_quota=True,user_id='27b6b003972c4ff781ed733a8000ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0b7d74-e282-48d5-98fb-fc98c17c9286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0b7d74-e282-48d5-98fb-fc98c17c9286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bad303-041a-48a9-9cc5-abce7fda2aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bad303-041a-48a9-9cc5-abce7fda2aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97fdb0f4-c37f-4046-908f-fa4ec4ed7d22', 'volume_name': 'volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8741831-9255-40c2-b8e6-5b1efa3c4b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8741831-9255-40c2-b8e6-5b1efa3c4b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e3f51d-25a6-4ae0-a667-65b10231326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Volume 97fdb0f4-c37f-4046-908f-fa4ec4ed7d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22', 'volume_size': 1} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1321492497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fdb0f4-c37f-4046-908f-fa4ec4ed7d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e4bb902e5f4701bc742002f757869f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:26Z,use_quota=True,user_id='27b6b003972c4ff781ed733a8000ac70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Creating volume 97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:26 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:26 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 1073741824 Sep 28 12:20:26 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:26 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 1073741824" returned: 0 in 0.563s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:26 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 Sep 28 12:20:26 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:27 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22" returned: 0 in 0.368s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e3f51d-25a6-4ae0-a667-65b10231326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ad450f-1e06-4564-ac76-bcfc516c90e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:27 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Volume volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 (97fdb0f4-c37f-4046-908f-fa4ec4ed7d22): created successfully Sep 28 12:20:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ad450f-1e06-4564-ac76-bcfc516c90e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Flow 'volume_create_manager' (da71006f-3e67-4b63-9ae9-92943f04ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8bd07c0e-de79-48a1-b29a-8cd57e7edcc1 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Created volume successfully. Sep 28 12:20:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Acquiring lock "cinder-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "cinder-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Acquiring lock "cinder-quobyte-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "cinder-quobyte-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b5769b-5f58-4063-8f85-b7f765df55bc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:29 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 Sep 28 12:20:29 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:29 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22" returned: 0 in 0.397s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:29 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22 Sep 28 12:20:29 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:30 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22" returned: 0 in 0.265s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "cinder-quobyte-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22" released by "delete_volume" :: held 0.706s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Created reservations ['087b1935-a4a1-44b2-ade2-85dd3cac009e', 'ebef931f-359f-41ea-99ae-508c268b8ca7', '736a9692-f9b2-4e9a-b66a-467cf989290c', '6446ddf8-6821-43ce-94c8-849f1bb0dae6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:30 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:20:30 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:30 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.337s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Deleted volume successfully. Sep 28 12:20:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9ad8881c-f1eb-488c-940a-42421a6d9256 tempest-VolumeQuotasNegativeTestJSON-1530395811 None] Lock "cinder-97fdb0f4-c37f-4046-908f-fa4ec4ed7d22-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Flow 'volume_create_manager' (df0a3038-eb93-41e4-8e55-dd3a13399473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e80dfa9-58ca-4249-97f9-0d43a3a5e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e80dfa9-58ca-4249-97f9-0d43a3a5e043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-575767913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b42ca9-33f2-481f-9d5e-275162e8d975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c8af6236264ce3a93a161c32435c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:40Z,use_quota=True,user_id='c1acdc3048e144e7a63632d85c7df59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311ef00a-01a8-4725-93f7-67a6970075bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311ef00a-01a8-4725-93f7-67a6970075bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08f7793-ba01-4a53-8ea8-f7c8f1ac0de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08f7793-ba01-4a53-8ea8-f7c8f1ac0de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b42ca9-33f2-481f-9d5e-275162e8d975', 'volume_name': 'volume-d9b42ca9-33f2-481f-9d5e-275162e8d975', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2035fad9-586c-4eb3-822a-dda4832824e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2035fad9-586c-4eb3-822a-dda4832824e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001f66a1-2197-475c-b8c7-24cf4c340563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Volume d9b42ca9-33f2-481f-9d5e-275162e8d975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b42ca9-33f2-481f-9d5e-275162e8d975', 'volume_size': 1} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-575767913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b42ca9-33f2-481f-9d5e-275162e8d975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c8af6236264ce3a93a161c32435c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:40Z,use_quota=True,user_id='c1acdc3048e144e7a63632d85c7df59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Creating volume d9b42ca9-33f2-481f-9d5e-275162e8d975 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:40 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 1073741824 Sep 28 12:20:40 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Flow 'volume_create_manager' (de63a5f8-87c9-442b-95b6-fe20c2c25fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb95bcd4-1ec8-4bae-9055-bbf73ba72c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb95bcd4-1ec8-4bae-9055-bbf73ba72c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1727584954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4837ac-45a1-49b5-8b80-7b45bfc61afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b3749b9ea149a0a9deafe73ac94ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:41Z,use_quota=True,user_id='f8702abe72ae4ccf96b570cb9208835f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db25269e-3496-409a-88c8-9be40e6bf9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db25269e-3496-409a-88c8-9be40e6bf9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a797b3-22d7-48b6-8f02-54c2e6480c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a797b3-22d7-48b6-8f02-54c2e6480c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4837ac-45a1-49b5-8b80-7b45bfc61afa', 'volume_name': 'volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7877f01-0535-4080-9068-a05117df318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7877f01-0535-4080-9068-a05117df318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b2662c-e5c2-4d75-9143-5808e71c3e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Volume bb4837ac-45a1-49b5-8b80-7b45bfc61afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa', 'volume_size': 1} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:41 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 1073741824" returned: 0 in 0.534s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:41 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 Sep 28 12:20:41 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:41 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975" returned: 0 in 0.260s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1727584954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4837ac-45a1-49b5-8b80-7b45bfc61afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b3749b9ea149a0a9deafe73ac94ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:41Z,use_quota=True,user_id='f8702abe72ae4ccf96b570cb9208835f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Creating volume bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:41 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001f66a1-2197-475c-b8c7-24cf4c340563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b42ca9-33f2-481f-9d5e-275162e8d975', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:41 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa 1073741824 Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a2f88e-f0a6-4314-8c80-ecb1381c8968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:41 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Volume volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 (d9b42ca9-33f2-481f-9d5e-275162e8d975): created successfully Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a2f88e-f0a6-4314-8c80-ecb1381c8968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Flow 'volume_create_manager' (df0a3038-eb93-41e4-8e55-dd3a13399473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0f64a9a0-b962-4ba2-8083-7c2fda926e30 tempest-AttachVolumeNegativeTest-434635671 None] Created volume successfully. Sep 28 12:20:42 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa 1073741824" returned: 0 in 0.571s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:42 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa Sep 28 12:20:42 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:42 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" returned: 0 in 0.268s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b2662c-e5c2-4d75-9143-5808e71c3e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76542ec-3f0f-4faf-8b19-1e61a2091ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:42 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Volume volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa (bb4837ac-45a1-49b5-8b80-7b45bfc61afa): created successfully Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76542ec-3f0f-4faf-8b19-1e61a2091ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Flow 'volume_create_manager' (de63a5f8-87c9-442b-95b6-fe20c2c25fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-32d73bda-dbcb-4ac2-bd90-52454e983a51 tempest-VolumesDeleteCascade-158804316 None] Created volume successfully. Sep 28 12:20:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Creating offline snapshot 5be29d90-ad15-4c27-9597-f95e7f732a51 of volume bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:20:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f43b2-8bf8-4ffc-8224-f51f2f523128]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-7c873c4a-69b8-4d3f-b6de-70260a3e4116 req-08003363-2172-4e8b-9c7f-35287f52eaf1 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:43 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa Sep 28 12:20:43 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:43 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" returned: 0 in 0.478s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:43 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 1G Sep 28 12:20:43 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:44 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 1G" returned: 0 in 0.458s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:44 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 Sep 28 12:20:44 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:44 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51" returned: 0 in 0.305s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:44 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 is being set with open permissions: ugo+rw Sep 28 12:20:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:44 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 Sep 28 12:20:44 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:44 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51" returned: 0 in 0.282s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:44 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.info Sep 28 12:20:44 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:45 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.info" returned: 0 in 0.277s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:45 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.info is being set with open permissions: ugo+rw Sep 28 12:20:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:45 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.info Sep 28 12:20:45 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:45 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.info" returned: 0 in 0.274s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-7c873c4a-69b8-4d3f-b6de-70260a3e4116 req-08003363-2172-4e8b-9c7f-35287f52eaf1 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.061s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-7c873c4a-69b8-4d3f-b6de-70260a3e4116 req-08003363-2172-4e8b-9c7f-35287f52eaf1 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a9cd0c7a-80f2-4e20-badb-1a2b9a34789a tempest-VolumesDeleteCascade-158804316 None] Create snapshot completed successfully Sep 28 12:20:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-7c873c4a-69b8-4d3f-b6de-70260a3e4116 req-08003363-2172-4e8b-9c7f-35287f52eaf1 tempest-AttachVolumeNegativeTest-434635671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-d9b42ca9-33f2-481f-9d5e-275162e8d975', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e69cb70e-0670-4a8e-9b50-7bcf3f8953e9', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:20:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-7c873c4a-69b8-4d3f-b6de-70260a3e4116 req-08003363-2172-4e8b-9c7f-35287f52eaf1 tempest-AttachVolumeNegativeTest-434635671 None] attachment_update completed successfully. Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Flow 'volume_create_manager' (ba5ee141-9a5b-499a-911b-9873ee2788d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c304c34b-fefb-43e5-8822-ac2f0fe7784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c304c34b-fefb-43e5-8822-ac2f0fe7784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2105495728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a02ad75-9545-4159-8ce0-035a566b3a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61107c95cba748a385f6911d2bc8a5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:47Z,use_quota=True,user_id='c48c1bac4a3240fb834eab5ebd15e8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fba5f32-6fe4-4e17-a409-261ed59abcef),volume_type_id=8fba5f32-6fe4-4e17-a409-261ed59abcef)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d6b548-27e3-4e03-a293-b5a057bc2d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d6b548-27e3-4e03-a293-b5a057bc2d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132aa9ad-1ed1-4dcd-9f14-f11cf7983cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132aa9ad-1ed1-4dcd-9f14-f11cf7983cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a02ad75-9545-4159-8ce0-035a566b3a1c', 'volume_name': 'volume-5a02ad75-9545-4159-8ce0-035a566b3a1c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1640038d-5fa1-4897-a6f3-abefc8bb058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1640038d-5fa1-4897-a6f3-abefc8bb058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537a5d9b-1e2f-48fc-a26c-28952fdbb9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume 5a02ad75-9545-4159-8ce0-035a566b3a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a02ad75-9545-4159-8ce0-035a566b3a1c', 'volume_size': 1} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2105495728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a02ad75-9545-4159-8ce0-035a566b3a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61107c95cba748a385f6911d2bc8a5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:47Z,use_quota=True,user_id='c48c1bac4a3240fb834eab5ebd15e8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fba5f32-6fe4-4e17-a409-261ed59abcef),volume_type_id=8fba5f32-6fe4-4e17-a409-261ed59abcef)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Creating volume 5a02ad75-9545-4159-8ce0-035a566b3a1c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:46 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:46 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c 1073741824 Sep 28 12:20:46 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Flow 'volume_create_manager' (96388341-6698-4da4-b207-1b6984fb3221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74ab43a-a206-49a3-b8bc-58952ace13dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74ab43a-a206-49a3-b8bc-58952ace13dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1730864088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7d7ffc-435e-47e6-8f9f-abcebd5b375e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61107c95cba748a385f6911d2bc8a5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:47Z,use_quota=True,user_id='c48c1bac4a3240fb834eab5ebd15e8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae37e0d0-36da-4d69-b449-4bd679252cea),volume_type_id=ae37e0d0-36da-4d69-b449-4bd679252cea)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a9cab1-c3a2-4b4b-9a50-5464f16e598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a9cab1-c3a2-4b4b-9a50-5464f16e598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cb585f-1bb2-43f7-9fa6-1c63ca1e3720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35cb585f-1bb2-43f7-9fa6-1c63ca1e3720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7d7ffc-435e-47e6-8f9f-abcebd5b375e', 'volume_name': 'volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38ce22a-0a6e-4da4-aae8-02abe6ab0c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38ce22a-0a6e-4da4-aae8-02abe6ab0c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196cdcef-202f-494f-a1b5-b5453077afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume cb7d7ffc-435e-47e6-8f9f-abcebd5b375e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e', 'volume_size': 1} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:47 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c 1073741824" returned: 0 in 0.536s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:47 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c Sep 28 12:20:47 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:47 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c" returned: 0 in 0.282s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.822s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537a5d9b-1e2f-48fc-a26c-28952fdbb9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a02ad75-9545-4159-8ce0-035a566b3a1c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141d5d0b-6f95-4ab3-90a3-acf75ea13f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Creating offline snapshot ccecd28b-d741-4900-810d-8487783d59c3 of volume bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:20:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume volume-5a02ad75-9545-4159-8ce0-035a566b3a1c (5a02ad75-9545-4159-8ce0-035a566b3a1c): created successfully Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141d5d0b-6f95-4ab3-90a3-acf75ea13f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Flow 'volume_create_manager' (ba5ee141-9a5b-499a-911b-9873ee2788d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f692c9-f533-4f18-8db3-e5303d204eeb]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:47 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9ef207bc-71e9-468e-bf49-bd18383676f0 tempest-TestInstancesWithCinderVolumes-1476682439 None] Created volume successfully. Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Flow 'volume_create_manager' (1e76228e-d407-4f88-a6a9-198719aea834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2a3960-8a6f-4477-9aca-213889aecf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2a3960-8a6f-4477-9aca-213889aecf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-919725657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ebfcb6-8900-4682-a462-be490c93966b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61107c95cba748a385f6911d2bc8a5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:48Z,use_quota=True,user_id='c48c1bac4a3240fb834eab5ebd15e8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74bb204e-7b45-44d4-a870-018398f77b7d),volume_type_id=74bb204e-7b45-44d4-a870-018398f77b7d)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e56c24-ab6a-4980-879f-d66f314578de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e56c24-ab6a-4980-879f-d66f314578de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a83f3ed-8d45-47eb-a91b-e4be41f9dad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:20:47 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 Sep 28 12:20:47 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a83f3ed-8d45-47eb-a91b-e4be41f9dad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90ebfcb6-8900-4682-a462-be490c93966b', 'volume_name': 'volume-90ebfcb6-8900-4682-a462-be490c93966b', 'volume_size': 1, 'image_id': 'bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--781886128', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61107c95cba748a385f6911d2bc8a5ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'created_at': datetime.datetime(2026, 9, 28, 10, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f18b86-f961-4878-b95a-f5ebd5f20b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:48 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f18b86-f961-4878-b95a-f5ebd5f20b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682c291b-40c7-4d7a-b039-1294a4c4d931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume 90ebfcb6-8900-4682-a462-be490c93966b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90ebfcb6-8900-4682-a462-be490c93966b', 'volume_size': 1, 'image_id': 'bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--781886128', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61107c95cba748a385f6911d2bc8a5ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'created_at': datetime.datetime(2026, 9, 28, 10, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41/file', 'properties': {}}, 'image_service': } Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Trying to clone 90ebfcb6-8900-4682-a462-be490c93966b from image bfb8eff6-b899-4b8d-84c0-257c1a05fb41 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51" returned: 0 in 0.469s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:48 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 1G Sep 28 12:20:48 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-189e453b-9204-44c4-8e22-61c5a537d2b9 req-011c9cb1-7f40-4fc6-b7d4-43649265f50e tempest-AttachVolumeNegativeTest-434635671 None] Terminate volume connection completed successfully. Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-189e453b-9204-44c4-8e22-61c5a537d2b9 req-011c9cb1-7f40-4fc6-b7d4-43649265f50e tempest-AttachVolumeNegativeTest-434635671 None] Deleting attachment e69cb70e-0670-4a8e-9b50-7bcf3f8953e9. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:20:48 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 1G" returned: 0 in 0.649s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:48 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 Sep 28 12:20:48 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:49 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:49 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 is being set with open permissions: ugo+rw Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:49 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 Sep 28 12:20:49 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:49 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:20:49 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:49 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3" returned: 0 in 0.352s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.486s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1730864088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7d7ffc-435e-47e6-8f9f-abcebd5b375e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61107c95cba748a385f6911d2bc8a5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:47Z,use_quota=True,user_id='c48c1bac4a3240fb834eab5ebd15e8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae37e0d0-36da-4d69-b449-4bd679252cea),volume_type_id=ae37e0d0-36da-4d69-b449-4bd679252cea)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Creating volume cb7d7ffc-435e-47e6-8f9f-abcebd5b375e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:49 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e 1073741824 Sep 28 12:20:49 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-312af484-5e06-4a5a-a0c5-ee6cedf7fa82 tempest-VolumesDeleteCascade-158804316 None] Create snapshot completed successfully Sep 28 12:20:49 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.397s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:20:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-bb4837ac-45a1-49b5-8b80-7b45bfc61afa-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-bb4837ac-45a1-49b5-8b80-7b45bfc61afa-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Performing cascade delete. {{(pid=87167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-5be29d90-ad15-4c27-9597-f95e7f732a51-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-5be29d90-ad15-4c27-9597-f95e7f732a51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-5be29d90-ad15-4c27-9597-f95e7f732a51" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-5be29d90-ad15-4c27-9597-f95e7f732a51" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Deleting offline snapshot 5be29d90-ad15-4c27-9597-f95e7f732a51 of volume bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] snapshot_file for this snap is: volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[451510c7-55fc-443e-a6be-03dd0df364fa]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:50 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e 1073741824" returned: 0 in 0.828s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:50 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e Sep 28 12:20:50 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:50 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 Sep 28 12:20:50 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:51 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e" returned: 0 in 0.534s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:51 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51" returned: 0 in 0.634s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196cdcef-202f-494f-a1b5-b5453077afd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc29a73c-2848-4845-8ff3-118478f3fa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ad5c55-fbf6-4bb7-b701-b42f1d307c23]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e (cb7d7ffc-435e-47e6-8f9f-abcebd5b375e): created successfully Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc29a73c-2848-4845-8ff3-118478f3fa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Flow 'volume_create_manager' (96388341-6698-4da4-b207-1b6984fb3221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4c4096e5-e586-4304-bcaf-a042a7cec6ac tempest-TestInstancesWithCinderVolumes-1476682439 None] Created volume successfully. Sep 28 12:20:51 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa Sep 28 12:20:51 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:51 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" returned: 0 in 0.565s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a81311-f856-4433-935e-8ca4e1e87eda]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:51 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 Sep 28 12:20:51 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:52 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3" returned: 0 in 0.544s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15cf06a-980f-44bd-8d3c-a7b2394dc2fd]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:52 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 Sep 28 12:20:52 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:52 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51" returned: 0 in 0.472s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3689f68c-5c4b-4be9-abc5-ef0606791ab3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:52 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa Sep 28 12:20:52 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:53 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" returned: 0 in 0.457s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:53 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 Sep 28 12:20:53 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD, size 20.69 MB, duration 5.28 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:20:53 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Image download 20.69 MB at 3.92 MB/s Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d06d615-03a1-4ba2-8e32-862af91ddae3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:53 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD Sep 28 12:20:53 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:53 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51" returned: 0 in 0.418s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:53 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51 Sep 28 12:20:53 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:53 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:53 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Temporary image bfb8eff6-b899-4b8d-84c0-257c1a05fb41 is fetched for user c48c1bac4a3240fb834eab5ebd15e8c7. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:20:54 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.5be29d90-ad15-4c27-9597-f95e7f732a51" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 -F qcow2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c808b5c-e372-4db0-ad2e-2ca03204d2ed]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:54 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 -F qcow2 Sep 28 12:20:54 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:54 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD Sep 28 12:20:54 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:54 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 -F qcow2" returned: 0 in 0.386s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:54 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-5be29d90-ad15-4c27-9597-f95e7f732a51" released by "_delete_snapshot" :: held 4.166s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-919725657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ebfcb6-8900-4682-a462-be490c93966b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61107c95cba748a385f6911d2bc8a5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:48Z,use_quota=True,user_id='c48c1bac4a3240fb834eab5ebd15e8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74bb204e-7b45-44d4-a870-018398f77b7d),volume_type_id=74bb204e-7b45-44d4-a870-018398f77b7d)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Creating volume 90ebfcb6-8900-4682-a462-be490c93966b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:54 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" released by "delete_snapshot" :: held 4.223s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:54 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b 1073741824 Sep 28 12:20:54 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Created reservations ['128ffe0b-0177-4f4b-878f-9973ff9b4382', '12ecf72a-8f56-4d69-82d5-52950c81c850', 'fbc1954f-6386-4184-a735-0972fc0b6fdf', 'efb90a04-00b1-4e97-bff1-6c32c33d1690'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Delete snapshot completed successfully. Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-5be29d90-ad15-4c27-9597-f95e7f732a51-delete_snapshot" released by "delete_snapshot" :: held 4.546s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-ccecd28b-d741-4900-810d-8487783d59c3-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-ccecd28b-d741-4900-810d-8487783d59c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-ccecd28b-d741-4900-810d-8487783d59c3" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-ccecd28b-d741-4900-810d-8487783d59c3" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Deleting offline snapshot ccecd28b-d741-4900-810d-8487783d59c3 of volume bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] snapshot_file for this snap is: volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2f65d9-8933-4e54-b684-fd36b61f4017]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:55 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 Sep 28 12:20:55 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:55 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b 1073741824" returned: 0 in 0.762s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:55 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b Sep 28 12:20:55 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:55 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3" returned: 0 in 0.504s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[036a8c13-7d05-4e73-8e53-3bd15fab5b0a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:55 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:55 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa Sep 28 12:20:55 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Attempting download of bfb8eff6-b899-4b8d-84c0-257c1a05fb41 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'metadata': {}}])) to volume 90ebfcb6-8900-4682-a462-be490c93966b. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ec0081-a0e9-4df0-8455-2b59f065cdcb]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_9rdocvwn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:55 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_9rdocvwn Sep 28 12:20:55 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:56 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" returned: 0 in 0.483s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:56 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 Sep 28 12:20:56 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:56 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_9rdocvwn" returned: 0 in 0.398s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_9rdocvwn {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:56 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_9rdocvwn Sep 28 12:20:56 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:56 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3" returned: 0 in 0.428s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:56 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3 Sep 28 12:20:56 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:56 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_9rdocvwn" returned: 1 in 0.373s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_9rdocvwn' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[620b1ad7-e117-47b1-9454-349fb957fd30]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:56 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD Sep 28 12:20:56 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:56 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa.ccecd28b-d741-4900-810d-8487783d59c3" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-ccecd28b-d741-4900-810d-8487783d59c3" released by "_delete_snapshot" :: held 1.924s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" released by "delete_snapshot" :: held 1.967s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:57 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] bfb8eff6-b899-4b8d-84c0-257c1a05fb41 was qcow2, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Created reservations ['c9be25f3-f838-4d0e-a2fc-729a5191ebc6', '354a47a5-231f-452d-877d-768831986e66', '103e814b-c3a9-4be0-96f3-857c9b703b6d', 'b44472b2-fae7-4cbd-b4af-b7366cc26835'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:57 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b Sep 28 12:20:57 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Delete snapshot completed successfully. Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-ccecd28b-d741-4900-810d-8487783d59c3-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Snapshots deleted, issuing volume delete {{(pid=87167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fced133-f019-45cb-91a8-416767671cf6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:57 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa Sep 28 12:20:57 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:57 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" returned: 0 in 0.453s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:57 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa Sep 28 12:20:57 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:57 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" returned: 0 in 0.326s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-bb4837ac-45a1-49b5-8b80-7b45bfc61afa" released by "delete_volume" :: held 0.871s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Created reservations ['38f70301-8ad3-4075-96d7-62973e7cc162', '2dca4c30-e431-4fdd-85b6-bb27869d7f31', 'ecc9a3f0-df61-4b36-a0e9-d54285f47d10', '8654ff63-481b-49e7-8916-87fd8cf02dd5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:58 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:20:58 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:58 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.301s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Deleted volume successfully. Sep 28 12:20:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c95f1010-9e2a-4f7b-8f8d-d8a3663350c5 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-bb4837ac-45a1-49b5-8b80-7b45bfc61afa-delete_volume" released by "delete_volume" :: held 8.471s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:59 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b" returned: 0 in 2.536s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfb8eff6-b899-4b8d-84c0-257c1a05fb41_uf6efdmjdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:20:59 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Converted 112.00 MB image at 44.14 MB/s Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:59 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b 1G Sep 28 12:20:59 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Flow 'volume_create_manager' (5cd0075c-105b-4828-83a2-b89bc933b872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dee825-d910-4198-ac7e-64263e811523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dee825-d910-4198-ac7e-64263e811523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-296817491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec65841-3a45-456d-bfe7-ebf315cc460b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b3749b9ea149a0a9deafe73ac94ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:00Z,use_quota=True,user_id='f8702abe72ae4ccf96b570cb9208835f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451b0204-fe88-4cdf-b4b5-298eec1c32e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451b0204-fe88-4cdf-b4b5-298eec1c32e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c12414-57aa-4e9d-8e8a-c89560cb6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c12414-57aa-4e9d-8e8a-c89560cb6e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec65841-3a45-456d-bfe7-ebf315cc460b', 'volume_name': 'volume-3ec65841-3a45-456d-bfe7-ebf315cc460b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274633d8-c349-4962-9e32-965d34317be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274633d8-c349-4962-9e32-965d34317be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab6c3c5-3533-47d8-bdda-bc8dffd522a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:59 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Volume 3ec65841-3a45-456d-bfe7-ebf315cc460b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec65841-3a45-456d-bfe7-ebf315cc460b', 'volume_size': 1} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-296817491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec65841-3a45-456d-bfe7-ebf315cc460b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b3749b9ea149a0a9deafe73ac94ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:00Z,use_quota=True,user_id='f8702abe72ae4ccf96b570cb9208835f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Creating volume 3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:59 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:59 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b 1G" returned: 0 in 0.411s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Downloaded image bfb8eff6-b899-4b8d-84c0-257c1a05fb41 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'metadata': {}}])) to volume 90ebfcb6-8900-4682-a462-be490c93966b successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Temporary image bfb8eff6-b899-4b8d-84c0-257c1a05fb41 for user c48c1bac4a3240fb834eab5ebd15e8c7 is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Marking volume 90ebfcb6-8900-4682-a462-be490c93966b as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:20:59 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b 1073741824 Sep 28 12:20:59 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Copying metadata from image bfb8eff6-b899-4b8d-84c0-257c1a05fb41 to 90ebfcb6-8900-4682-a462-be490c93966b. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:20:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Creating volume glance metadata for volume 90ebfcb6-8900-4682-a462-be490c93966b backed by image bfb8eff6-b899-4b8d-84c0-257c1a05fb41 with: {'image_id': 'bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'image_name': 'tempest-scenario-img--781886128', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682c291b-40c7-4d7a-b039-1294a4c4d931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ebfcb6-8900-4682-a462-be490c93966b', 'volume_size': 1, 'image_id': 'bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--781886128', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61107c95cba748a385f6911d2bc8a5ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfb8eff6-b899-4b8d-84c0-257c1a05fb41', 'created_at': datetime.datetime(2026, 9, 28, 10, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfb8eff6-b899-4b8d-84c0-257c1a05fb41/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f0aef7-5283-4f1e-a781-95a4575a6412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Volume volume-90ebfcb6-8900-4682-a462-be490c93966b (90ebfcb6-8900-4682-a462-be490c93966b): created successfully Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f0aef7-5283-4f1e-a781-95a4575a6412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Flow 'volume_create_manager' (1e76228e-d407-4f88-a6a9-198719aea834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-17b892b3-98a8-4901-893c-7858cb4a4674 tempest-TestInstancesWithCinderVolumes-1476682439 None] Created volume successfully. Sep 28 12:21:00 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b 1073741824" returned: 0 in 0.577s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:00 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b Sep 28 12:21:00 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:00 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b" returned: 0 in 0.410s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab6c3c5-3533-47d8-bdda-bc8dffd522a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec65841-3a45-456d-bfe7-ebf315cc460b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113eb91d-4b8c-41c6-8331-f81ad0b3d9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Volume volume-3ec65841-3a45-456d-bfe7-ebf315cc460b (3ec65841-3a45-456d-bfe7-ebf315cc460b): created successfully Sep 28 12:21:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113eb91d-4b8c-41c6-8331-f81ad0b3d9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Flow 'volume_create_manager' (5cd0075c-105b-4828-83a2-b89bc933b872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5c4107d5-40b2-4780-8474-2de803a31d9e tempest-VolumesDeleteCascade-158804316 None] Created volume successfully. Sep 28 12:21:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Creating offline snapshot 19a97764-9292-4807-8456-ef5aaf43810b of volume 3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:21:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce70247f-d050-4f78-8be7-1f439334d0ab]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:02 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b Sep 28 12:21:02 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:02 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b" returned: 0 in 0.601s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:02 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b 1G Sep 28 12:21:02 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:03 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b 1G" returned: 0 in 0.616s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec65841-3a45-456d-bfe7-ebf315cc460b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:03 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec65841-3a45-456d-bfe7-ebf315cc460b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b Sep 28 12:21:03 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:04 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec65841-3a45-456d-bfe7-ebf315cc460b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b" returned: 0 in 0.537s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:04 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b is being set with open permissions: ugo+rw Sep 28 12:21:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:04 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b Sep 28 12:21:04 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:04 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b" returned: 0 in 0.614s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:04 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.info Sep 28 12:21:04 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e5128237-a284-4052-8f79-704e43ad12f4 req-ac1b9a42-16d9-44b6-959f-a8caa59d08d6 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:05 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.info" returned: 0 in 0.492s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:05 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.info is being set with open permissions: ugo+rw Sep 28 12:21:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:05 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.info Sep 28 12:21:05 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:05 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.info" returned: 0 in 0.331s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.419s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e5128237-a284-4052-8f79-704e43ad12f4 req-ac1b9a42-16d9-44b6-959f-a8caa59d08d6 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.571s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e5128237-a284-4052-8f79-704e43ad12f4 req-ac1b9a42-16d9-44b6-959f-a8caa59d08d6 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-644bf97f-1d57-496f-a8f7-aa8d5f171a54 tempest-VolumesDeleteCascade-158804316 None] Create snapshot completed successfully Sep 28 12:21:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-e5128237-a284-4052-8f79-704e43ad12f4 req-ac1b9a42-16d9-44b6-959f-a8caa59d08d6 tempest-TestInstancesWithCinderVolumes-1476682439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-90ebfcb6-8900-4682-a462-be490c93966b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a75ce17-5c91-491f-b804-da2a5a813590', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:21:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-e5128237-a284-4052-8f79-704e43ad12f4 req-ac1b9a42-16d9-44b6-959f-a8caa59d08d6 tempest-TestInstancesWithCinderVolumes-1476682439 None] attachment_update completed successfully. Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Flow 'volume_create_manager' (fd3c7f50-57c0-40d6-bdd8-997b3d0f77ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e09b5ae-93c4-4b86-a3f0-0b2ed930f7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e09b5ae-93c4-4b86-a3f0-0b2ed930f7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1922397496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f1488a-3890-4cee-8f2b-fef0e9406787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b3749b9ea149a0a9deafe73ac94ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19a97764-9292-4807-8456-ef5aaf43810b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:07Z,use_quota=True,user_id='f8702abe72ae4ccf96b570cb9208835f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8e69ed-2cc6-44ea-8b94-e79b1905e7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8e69ed-2cc6-44ea-8b94-e79b1905e7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fa242f-8730-40ef-96b7-38703cd9a9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fa242f-8730-40ef-96b7-38703cd9a9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82f1488a-3890-4cee-8f2b-fef0e9406787', 'volume_name': 'volume-82f1488a-3890-4cee-8f2b-fef0e9406787', 'volume_size': 1, 'snapshot_id': '19a97764-9292-4807-8456-ef5aaf43810b'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549d8fb5-5965-4c17-8201-52be3c8d87bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549d8fb5-5965-4c17-8201-52be3c8d87bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f264a2cd-032c-4ee8-aa9b-c808c58831fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Volume 82f1488a-3890-4cee-8f2b-fef0e9406787: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82f1488a-3890-4cee-8f2b-fef0e9406787', 'volume_size': 1, 'snapshot_id': '19a97764-9292-4807-8456-ef5aaf43810b'} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-19a97764-9292-4807-8456-ef5aaf43810b-82f1488a-3890-4cee-8f2b-fef0e9406787" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-19a97764-9292-4807-8456-ef5aaf43810b-82f1488a-3890-4cee-8f2b-fef0e9406787" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Creating volume 82f1488a-3890-4cee-8f2b-fef0e9406787 from snapshot 19a97764-9292-4807-8456-ef5aaf43810b {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-82f1488a-3890-4cee-8f2b-fef0e9406787" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-82f1488a-3890-4cee-8f2b-fef0e9406787" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] snapshot: 19a97764-9292-4807-8456-ef5aaf43810b, volume: 82f1488a-3890-4cee-8f2b-fef0e9406787, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b180b4e-1373-4b36-906b-316a592aae09]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:07 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b Sep 28 12:21:07 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:08 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b" returned: 0 in 0.543s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ec65841-3a45-456d-bfe7-ebf315cc460b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[673fb8f9-52a7-4c93-a34d-bcc9873e16d1]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:08 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b Sep 28 12:21:08 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:08 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b" returned: 0 in 0.566s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:21:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:09 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 Sep 28 12:21:09 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:21 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=68,cinder:UPDATE=43,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:21:21 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=59,cinder:UPDATE=61,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:21:22 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787" returned: 0 in 13.345s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b, size 1024.00 MB, duration 13.35 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:21:22 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Converted 1024.00 MB image at 76.72 MB/s Sep 28 12:21:22 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 is being set with open permissions: ugo+rw Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:22 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 Sep 28 12:21:22 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:22 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-82f1488a-3890-4cee-8f2b-fef0e9406787" released by "_copy_volume_from_snapshot" :: held 15.014s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-19a97764-9292-4807-8456-ef5aaf43810b-82f1488a-3890-4cee-8f2b-fef0e9406787" released by "_create_volume_from_snapshot" :: held 15.105s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.148s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f264a2cd-032c-4ee8-aa9b-c808c58831fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f1488a-3890-4cee-8f2b-fef0e9406787', 'volume_size': 1, 'snapshot_id': '19a97764-9292-4807-8456-ef5aaf43810b'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41390340-1a32-42b6-ba17-eda3c2a34351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:22 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Volume volume-82f1488a-3890-4cee-8f2b-fef0e9406787 (82f1488a-3890-4cee-8f2b-fef0e9406787): created successfully Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41390340-1a32-42b6-ba17-eda3c2a34351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Flow 'volume_create_manager' (fd3c7f50-57c0-40d6-bdd8-997b3d0f77ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-09a39e37-d932-414b-b720-8b28061a1ef1 tempest-VolumesDeleteCascade-158804316 None] Created volume successfully. Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-3ec65841-3a45-456d-bfe7-ebf315cc460b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-3ec65841-3a45-456d-bfe7-ebf315cc460b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Performing cascade delete. {{(pid=87167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-19a97764-9292-4807-8456-ef5aaf43810b-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-19a97764-9292-4807-8456-ef5aaf43810b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-3ec65841-3a45-456d-bfe7-ebf315cc460b" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-3ec65841-3a45-456d-bfe7-ebf315cc460b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-19a97764-9292-4807-8456-ef5aaf43810b" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-19a97764-9292-4807-8456-ef5aaf43810b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Deleting offline snapshot 19a97764-9292-4807-8456-ef5aaf43810b of volume 3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] snapshot_file for this snap is: volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[efadbde2-38ae-4422-861f-33f6bf21eec3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:23 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b Sep 28 12:21:23 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:24 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b" returned: 0 in 0.479s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ec65841-3a45-456d-bfe7-ebf315cc460b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2454f8e-ed39-47c2-80dd-207e64d58d8a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:24 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b Sep 28 12:21:24 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:24 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b" returned: 0 in 0.613s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:24 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b Sep 28 12:21:24 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:25 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b" returned: 0 in 0.478s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:25 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b Sep 28 12:21:25 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:25 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b.19a97764-9292-4807-8456-ef5aaf43810b" returned: 0 in 0.295s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-19a97764-9292-4807-8456-ef5aaf43810b" released by "_delete_snapshot" :: held 2.013s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-3ec65841-3a45-456d-bfe7-ebf315cc460b" released by "delete_snapshot" :: held 2.053s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Created reservations ['4c181479-5e30-419d-aad4-272538b1b79a', 'a834ca2c-80da-40d9-8dad-8c3ee1644fee', '52a31087-24c3-4102-a390-c0953248e22b', 'd1ccc097-34fb-4383-a76d-57708e01d3ea'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Delete snapshot completed successfully. Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-19a97764-9292-4807-8456-ef5aaf43810b-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Snapshots deleted, issuing volume delete {{(pid=87167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-3ec65841-3a45-456d-bfe7-ebf315cc460b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-3ec65841-3a45-456d-bfe7-ebf315cc460b" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ef7ee-ec1b-4c47-b3f9-5f3ca11aaea4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:25 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b Sep 28 12:21:25 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:26 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b" returned: 0 in 0.434s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:26 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b Sep 28 12:21:26 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:26 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3ec65841-3a45-456d-bfe7-ebf315cc460b" returned: 0 in 0.287s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-3ec65841-3a45-456d-bfe7-ebf315cc460b" released by "delete_volume" :: held 0.796s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Created reservations ['aff4f244-7566-4bb0-a564-999b913f391f', 'e67a30cf-f35e-4b02-be81-69665e18fcab', '8c7f0cb9-24f5-4b1e-8fee-01512d6a3462', '051d5cd7-c078-4927-9cb3-7f4cec681815'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:26 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:26 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-82f1488a-3890-4cee-8f2b-fef0e9406787-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-82f1488a-3890-4cee-8f2b-fef0e9406787-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "cinder-quobyte-82f1488a-3890-4cee-8f2b-fef0e9406787" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-82f1488a-3890-4cee-8f2b-fef0e9406787" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[247f915f-cbc3-406c-b13d-d8ac1b6431e6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:27 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.418s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Deleted volume successfully. Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-83be483e-3227-4055-b23d-069f953d67e9 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-3ec65841-3a45-456d-bfe7-ebf315cc460b-delete_volume" released by "delete_volume" :: held 3.857s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:27 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 Sep 28 12:21:27 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:27 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787" returned: 0 in 0.469s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:27 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787 Sep 28 12:21:27 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:27 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-82f1488a-3890-4cee-8f2b-fef0e9406787" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-quobyte-82f1488a-3890-4cee-8f2b-fef0e9406787" released by "delete_volume" :: held 0.862s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Created reservations ['d9146950-4a52-4de3-ad1f-d4523a0fbeb9', '72bc5f92-2f65-4efe-a081-4a148b0ce415', 'c292174a-a539-4cbd-847e-81a49ca136fc', '828b830c-4481-4688-9203-2939643c1401'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:28 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:28 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:28 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.419s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Deleted volume successfully. Sep 28 12:21:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6ce4b7f7-6b1d-4d1e-bcde-583a721d0e04 tempest-VolumesDeleteCascade-158804316 None] Lock "cinder-82f1488a-3890-4cee-8f2b-fef0e9406787-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Flow 'volume_create_manager' (33ac2586-7937-4495-b260-84f82ea740d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3240672-95bf-40e0-9154-c506a64d3f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3240672-95bf-40e0-9154-c506a64d3f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1954886152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5967e5ce-8067-4844-8f1f-4ea21780f826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1900669c7bac45179539ec9b0ceeba00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:33Z,use_quota=True,user_id='8099626e3f0340728b3fb3a325ad295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310951bc-d650-4790-8c14-2ecd24b7c497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310951bc-d650-4790-8c14-2ecd24b7c497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b48ed3-53f7-4ae7-a464-95920f00d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b48ed3-53f7-4ae7-a464-95920f00d21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5967e5ce-8067-4844-8f1f-4ea21780f826', 'volume_name': 'volume-5967e5ce-8067-4844-8f1f-4ea21780f826', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cb4145-1867-4fb7-8af6-f8063ffa668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cb4145-1867-4fb7-8af6-f8063ffa668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c113842a-7da1-42fc-be0a-31db044d1e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Volume 5967e5ce-8067-4844-8f1f-4ea21780f826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5967e5ce-8067-4844-8f1f-4ea21780f826', 'volume_size': 1} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1954886152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5967e5ce-8067-4844-8f1f-4ea21780f826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1900669c7bac45179539ec9b0ceeba00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:33Z,use_quota=True,user_id='8099626e3f0340728b3fb3a325ad295f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Creating volume 5967e5ce-8067-4844-8f1f-4ea21780f826 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:33 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 1073741824 Sep 28 12:21:33 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:33 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 1073741824" returned: 0 in 0.514s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:33 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 Sep 28 12:21:33 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:34 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826" returned: 0 in 0.326s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c113842a-7da1-42fc-be0a-31db044d1e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5967e5ce-8067-4844-8f1f-4ea21780f826', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5719d3e-0cf1-443f-aa09-af8e1635ad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Volume volume-5967e5ce-8067-4844-8f1f-4ea21780f826 (5967e5ce-8067-4844-8f1f-4ea21780f826): created successfully Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5719d3e-0cf1-443f-aa09-af8e1635ad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Flow 'volume_create_manager' (33ac2586-7937-4495-b260-84f82ea740d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e368a549-9f7e-42de-96f4-d5bfb9ac5bda tempest-VolumesMetadataTest-1157923479 None] Created volume successfully. Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Flow 'volume_create_manager' (9ef42560-ce60-4b5a-980e-b5fa98eae46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5927990-ecfa-47df-bbe1-0368608492ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5927990-ecfa-47df-bbe1-0368608492ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-570344733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe9059f-2ee3-4219-a88e-ee6c3f00e457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c8af6236264ce3a93a161c32435c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:35Z,use_quota=True,user_id='c1acdc3048e144e7a63632d85c7df59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769abbbc-c61e-489d-a753-fe10d75c581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769abbbc-c61e-489d-a753-fe10d75c581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5f9747-19a9-419b-a642-ffc7b7cbdaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5f9747-19a9-419b-a642-ffc7b7cbdaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe9059f-2ee3-4219-a88e-ee6c3f00e457', 'volume_name': 'volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77b627a-cab9-4a7e-b21b-6c83a2ff7d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77b627a-cab9-4a7e-b21b-6c83a2ff7d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3cad2b-3bd6-4e99-86e2-b495d42a02fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Volume 7fe9059f-2ee3-4219-a88e-ee6c3f00e457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457', 'volume_size': 1} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-570344733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe9059f-2ee3-4219-a88e-ee6c3f00e457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c8af6236264ce3a93a161c32435c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:35Z,use_quota=True,user_id='c1acdc3048e144e7a63632d85c7df59a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Creating volume 7fe9059f-2ee3-4219-a88e-ee6c3f00e457 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:34 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:21:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:34 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 1073741824 Sep 28 12:21:34 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:35 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 1073741824" returned: 0 in 0.686s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:35 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 Sep 28 12:21:35 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:35 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457" returned: 0 in 0.380s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3cad2b-3bd6-4e99-86e2-b495d42a02fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e672861-22e9-405d-8603-22bc072f02c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:36 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Volume volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 (7fe9059f-2ee3-4219-a88e-ee6c3f00e457): created successfully Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e672861-22e9-405d-8603-22bc072f02c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Flow 'volume_create_manager' (9ef42560-ce60-4b5a-980e-b5fa98eae46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4a22d392-4d11-4986-9473-9d3c9d8c7414 tempest-AttachVolumeNegativeTest-434635671 None] Created volume successfully. Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Acquiring lock "cinder-5967e5ce-8067-4844-8f1f-4ea21780f826-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Lock "cinder-5967e5ce-8067-4844-8f1f-4ea21780f826-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Acquiring lock "cinder-quobyte-5967e5ce-8067-4844-8f1f-4ea21780f826" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Lock "cinder-quobyte-5967e5ce-8067-4844-8f1f-4ea21780f826" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f4f7f0-720b-4ac1-b19d-c9de41bf1f94]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:36 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 Sep 28 12:21:36 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:36 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826" returned: 0 in 0.451s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:36 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826 Sep 28 12:21:36 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:37 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5967e5ce-8067-4844-8f1f-4ea21780f826" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Lock "cinder-quobyte-5967e5ce-8067-4844-8f1f-4ea21780f826" released by "delete_volume" :: held 0.831s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Created reservations ['346cf908-dae5-472d-9d53-e853dc93fa95', '7b24ff92-c669-4c85-b9fe-7f49acab2bd8', '1529ec8d-68b1-43c6-8f2c-b3d06ae050a2', '9d12e7da-3b63-4009-8564-8054dfa0afce'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:37 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:37 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:37 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.341s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Deleted volume successfully. Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1c87ad96-61b1-4235-b3b8-df5d38aaa96f tempest-VolumesMetadataTest-1157923479 None] Lock "cinder-5967e5ce-8067-4844-8f1f-4ea21780f826-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-175931ac-7b85-48dd-bf3e-54b377c366ef req-2f381255-9cc5-4052-a405-7840cab8664f tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-175931ac-7b85-48dd-bf3e-54b377c366ef req-2f381255-9cc5-4052-a405-7840cab8664f tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-175931ac-7b85-48dd-bf3e-54b377c366ef req-2f381255-9cc5-4052-a405-7840cab8664f tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-175931ac-7b85-48dd-bf3e-54b377c366ef req-2f381255-9cc5-4052-a405-7840cab8664f tempest-AttachVolumeNegativeTest-434635671 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3563fc87-6e25-4c74-9df7-d742e04aa537', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:21:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-175931ac-7b85-48dd-bf3e-54b377c366ef req-2f381255-9cc5-4052-a405-7840cab8664f tempest-AttachVolumeNegativeTest-434635671 None] attachment_update completed successfully. Sep 28 12:21:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-ca34fc4a-1776-43b4-8768-7831b9617a4e req-381292fe-a7db-4059-b247-408fd018a3b2 tempest-AttachVolumeNegativeTest-434635671 None] Terminate volume connection completed successfully. Sep 28 12:21:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ca34fc4a-1776-43b4-8768-7831b9617a4e req-381292fe-a7db-4059-b247-408fd018a3b2 tempest-AttachVolumeNegativeTest-434635671 None] Deleting attachment 3563fc87-6e25-4c74-9df7-d742e04aa537. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Flow 'volume_create_manager' (8c3a2932-f1a4-4d19-a398-bd90d48b69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d63311-b3d1-4f36-89d7-a6909c7d863f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d63311-b3d1-4f36-89d7-a6909c7d863f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1203604535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb27eae9-0869-4fd2-a8f3-8d05175ee792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2086546eb6e4842981aa2d84ab5761f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:43Z,use_quota=True,user_id='f055e332f9a54a909de5fb8fae8f7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d856d316-c470-481a-8dc8-404c0aba2d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d856d316-c470-481a-8dc8-404c0aba2d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a633e189-b4f2-432d-a6a4-41a3c62f9e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a633e189-b4f2-432d-a6a4-41a3c62f9e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb27eae9-0869-4fd2-a8f3-8d05175ee792', 'volume_name': 'volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b1e058-4ee3-4863-bb5e-b9337c890cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b1e058-4ee3-4863-bb5e-b9337c890cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138d1777-31c9-4e67-aaf5-d179e0da5ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:43 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Volume eb27eae9-0869-4fd2-a8f3-8d05175ee792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792', 'volume_size': 1} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1203604535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb27eae9-0869-4fd2-a8f3-8d05175ee792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2086546eb6e4842981aa2d84ab5761f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:43Z,use_quota=True,user_id='f055e332f9a54a909de5fb8fae8f7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Creating volume eb27eae9-0869-4fd2-a8f3-8d05175ee792 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:43 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:21:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:43 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 1073741824 Sep 28 12:21:43 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:44 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 1073741824" returned: 0 in 0.683s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:44 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 Sep 28 12:21:44 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:44 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792" returned: 0 in 0.396s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138d1777-31c9-4e67-aaf5-d179e0da5ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cd325a-8daa-40f3-8091-231209718149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:44 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Volume volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 (eb27eae9-0869-4fd2-a8f3-8d05175ee792): created successfully Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cd325a-8daa-40f3-8091-231209718149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Flow 'volume_create_manager' (8c3a2932-f1a4-4d19-a398-bd90d48b69a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0d3d6195-a0ff-4d66-bd48-f3d7c2b7fd5f tempest-VolumesTransfersTest-794918988 None] Created volume successfully. Sep 28 12:21:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1e6a50cf-4210-40fc-8887-67089dd6e2a2 tempest-VolumesTransfersTest-1287338849 None] Transfer volume completed successfully. Sep 28 12:21:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "cinder-7fe9059f-2ee3-4219-a88e-ee6c3f00e457-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-7fe9059f-2ee3-4219-a88e-ee6c3f00e457-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "cinder-quobyte-7fe9059f-2ee3-4219-a88e-ee6c3f00e457" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-quobyte-7fe9059f-2ee3-4219-a88e-ee6c3f00e457" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:46 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb23083-6cc6-41a3-85b4-00de8294e096]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:47 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 Sep 28 12:21:47 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Acquiring lock "cinder-eb27eae9-0869-4fd2-a8f3-8d05175ee792-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Lock "cinder-eb27eae9-0869-4fd2-a8f3-8d05175ee792-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Acquiring lock "cinder-quobyte-eb27eae9-0869-4fd2-a8f3-8d05175ee792" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:47 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Lock "cinder-quobyte-eb27eae9-0869-4fd2-a8f3-8d05175ee792" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457" returned: 0 in 0.469s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[56149f79-42d5-47b2-9d07-f0a93645593e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:47 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457 Sep 28 12:21:47 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:47 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 Sep 28 12:21:47 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:47 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7fe9059f-2ee3-4219-a88e-ee6c3f00e457" returned: 0 in 0.281s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-quobyte-7fe9059f-2ee3-4219-a88e-ee6c3f00e457" released by "delete_volume" :: held 0.799s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Created reservations ['69eb1407-5bf7-4763-a2d5-a08def678285', 'da43e575-9795-4ac6-8850-c5ff2c7ed4b8', '23ea3aae-215d-4d2a-b0a8-896cdaff2753', 'a92e1c6e-5623-4b46-8cd5-b87d57587a30'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:47 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792" returned: 0 in 0.430s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:47 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792 Sep 28 12:21:47 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:47 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:47 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:48 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "cinder-d9b42ca9-33f2-481f-9d5e-275162e8d975-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-eb27eae9-0869-4fd2-a8f3-8d05175ee792" returned: 0 in 0.312s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:48 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.309s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Lock "cinder-quobyte-eb27eae9-0869-4fd2-a8f3-8d05175ee792" released by "delete_volume" :: held 0.806s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-d9b42ca9-33f2-481f-9d5e-275162e8d975-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Deleted volume successfully. Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fecaf9f1-a8f0-4115-a523-4f436ec53126 tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-7fe9059f-2ee3-4219-a88e-ee6c3f00e457-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "cinder-quobyte-d9b42ca9-33f2-481f-9d5e-275162e8d975" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-quobyte-d9b42ca9-33f2-481f-9d5e-275162e8d975" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Created reservations ['20ee3dcb-5bc0-493b-971d-0e319a0f3544', 'cb24c6e4-5574-49af-83b4-a956d390df4a', '1f5d4754-2b7c-4c69-bc60-37b0de462c78', '9be97b04-4f2c-4d2f-98d4-df3a1d8b9c63'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf624c8f-f6a1-46b4-ba21-84b50e5fc81e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:48 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:48 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 Sep 28 12:21:48 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:48 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:48 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.355s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Deleted volume successfully. Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9564e9f9-bcae-46dd-85c1-a35440eb8bbf tempest-VolumesTransfersTest-349543677 None] Lock "cinder-eb27eae9-0869-4fd2-a8f3-8d05175ee792-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:48 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975" returned: 0 in 0.551s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:48 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975 Sep 28 12:21:48 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Flow 'volume_create_manager' (ffb80bec-990b-4c02-8c9d-fa045a8596e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d435e27-2441-4e17-a94e-341840bcd35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:49 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9b42ca9-33f2-481f-9d5e-275162e8d975" returned: 0 in 0.365s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d435e27-2441-4e17-a94e-341840bcd35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-166457006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42466bf3-3a2f-4c5e-8e75-f0ce24479509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2086546eb6e4842981aa2d84ab5761f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:49Z,use_quota=True,user_id='f055e332f9a54a909de5fb8fae8f7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3ef69b-372c-4e78-a390-a283a3f41186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3ef69b-372c-4e78-a390-a283a3f41186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a86ff3a-d5c7-4f97-b404-5fa4e31ac177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a86ff3a-d5c7-4f97-b404-5fa4e31ac177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42466bf3-3a2f-4c5e-8e75-f0ce24479509', 'volume_name': 'volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902b3470-8239-4bda-bc70-db25ff38a069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902b3470-8239-4bda-bc70-db25ff38a069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1aadb27-f998-47cc-b587-58d7809a1842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Volume 42466bf3-3a2f-4c5e-8e75-f0ce24479509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509', 'volume_size': 1} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-166457006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42466bf3-3a2f-4c5e-8e75-f0ce24479509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2086546eb6e4842981aa2d84ab5761f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:49Z,use_quota=True,user_id='f055e332f9a54a909de5fb8fae8f7600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Creating volume 42466bf3-3a2f-4c5e-8e75-f0ce24479509 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-quobyte-d9b42ca9-33f2-481f-9d5e-275162e8d975" released by "delete_volume" :: held 1.059s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:49 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 1073741824 Sep 28 12:21:49 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Created reservations ['64e69935-f227-483e-8075-a6446cff421b', 'fcadf416-1353-4f35-8c4c-e41d355d4bd2', 'ea621919-caef-4723-9f07-eb4317ac15e9', 'e648f3b0-6283-4626-9fd0-9e9aeb43599b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:49 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:49 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-cfa26f54-81d1-4b7f-8749-1945f9a1ea69 req-69f3d410-d136-4164-9781-c2dab3f3f2e7 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:49 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:49 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:49 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.329s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:21:49 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:49 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 1073741824" returned: 0 in 0.546s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Deleted volume successfully. Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e9237db-10f0-4c4b-9f34-18166b568528 tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-d9b42ca9-33f2-481f-9d5e-275162e8d975-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:50 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 Sep 28 12:21:50 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:50 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509" returned: 0 in 0.276s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-cfa26f54-81d1-4b7f-8749-1945f9a1ea69 req-69f3d410-d136-4164-9781-c2dab3f3f2e7 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.682s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1aadb27-f998-47cc-b587-58d7809a1842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6b420f-b88c-4454-891b-1ef63170660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-cfa26f54-81d1-4b7f-8749-1945f9a1ea69 req-69f3d410-d136-4164-9781-c2dab3f3f2e7 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Volume volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 (42466bf3-3a2f-4c5e-8e75-f0ce24479509): created successfully Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6b420f-b88c-4454-891b-1ef63170660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Flow 'volume_create_manager' (ffb80bec-990b-4c02-8c9d-fa045a8596e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6e5e146e-c30c-4645-a754-4a9c766751c0 tempest-VolumesTransfersTest-794918988 None] Created volume successfully. Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-cfa26f54-81d1-4b7f-8749-1945f9a1ea69 req-69f3d410-d136-4164-9781-c2dab3f3f2e7 tempest-TestInstancesWithCinderVolumes-1476682439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-5a02ad75-9545-4159-8ce0-035a566b3a1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '678fb870-6647-43b9-adcb-9a2c412375a5', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:21:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-cfa26f54-81d1-4b7f-8749-1945f9a1ea69 req-69f3d410-d136-4164-9781-c2dab3f3f2e7 tempest-TestInstancesWithCinderVolumes-1476682439 None] attachment_update completed successfully. Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "cinder-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "cinder-quobyte-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-quobyte-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca5a9f-9b59-428b-9357-a54b8e4f56e9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:50 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a Sep 28 12:21:50 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:51 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a" returned: 0 in 0.472s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:51 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a Sep 28 12:21:51 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:51 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a" returned: 0 in 0.322s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-quobyte-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a" released by "delete_volume" :: held 0.853s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Acquiring lock "cinder-42466bf3-3a2f-4c5e-8e75-f0ce24479509-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Created reservations ['eeb64116-17dc-4f94-b9f2-558297fe28a7', '17d2f658-26a1-49e5-a561-c630071246e6', '7a238171-0c55-4293-bda7-7a8da3a1ae20', 'd01d6f29-6fd6-45ee-8199-6fdf3cd9af5e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Lock "cinder-42466bf3-3a2f-4c5e-8e75-f0ce24479509-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Acquiring lock "cinder-quobyte-42466bf3-3a2f-4c5e-8e75-f0ce24479509" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Lock "cinder-quobyte-42466bf3-3a2f-4c5e-8e75-f0ce24479509" acquired by "delete_volume" :: waited 0.056s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:51 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:51 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[535e8cdd-7468-4788-98c8-ca27c5644367]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:52 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 Sep 28 12:21:52 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:52 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Deleted volume successfully. Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6d18b133-cb72-43e0-8ccd-babb2e3299fe tempest-AttachVolumeNegativeTest-434635671 None] Lock "cinder-960f3b6e-3b86-4f8c-acfd-f6bd7df20f9a-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:52 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509" returned: 0 in 0.523s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:52 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509 Sep 28 12:21:52 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:52 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-42466bf3-3a2f-4c5e-8e75-f0ce24479509" returned: 0 in 0.350s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Lock "cinder-quobyte-42466bf3-3a2f-4c5e-8e75-f0ce24479509" released by "delete_volume" :: held 0.944s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Created reservations ['2461c32a-fb80-4ef0-89c7-30d808e76d75', 'cd05c873-2dd5-4aac-b361-a6d7c04ad183', '5ae547f0-209c-4602-9c96-dd6bbc5d1b0b', '0349b86e-1238-4ccf-a14e-08c85c4d6bdd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-93017d70-6665-4532-90d9-ecf078e6a359 req-5d891329-75ad-4e6e-88f1-6f94404c12ab tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-93017d70-6665-4532-90d9-ecf078e6a359 req-5d891329-75ad-4e6e-88f1-6f94404c12ab tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-93017d70-6665-4532-90d9-ecf078e6a359 req-5d891329-75ad-4e6e-88f1-6f94404c12ab tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-93017d70-6665-4532-90d9-ecf078e6a359 req-5d891329-75ad-4e6e-88f1-6f94404c12ab tempest-TestInstancesWithCinderVolumes-1476682439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33d2952b-e893-4076-abd5-9c77b23b841b', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:53 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:21:53 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-93017d70-6665-4532-90d9-ecf078e6a359 req-5d891329-75ad-4e6e-88f1-6f94404c12ab tempest-TestInstancesWithCinderVolumes-1476682439 None] attachment_update completed successfully. Sep 28 12:21:53 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.343s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Deleted volume successfully. Sep 28 12:21:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8f599a11-7443-4c75-89c1-1a13e640cd00 tempest-VolumesTransfersTest-349543677 None] Lock "cinder-42466bf3-3a2f-4c5e-8e75-f0ce24479509-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-f18d45ad-f818-4f69-b15b-4fa4104d7fa4 req-98bce1da-c0c3-412e-993e-60285f7cadf2 tempest-TestInstancesWithCinderVolumes-1476682439 None] Terminate volume connection completed successfully. Sep 28 12:22:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-f18d45ad-f818-4f69-b15b-4fa4104d7fa4 req-98bce1da-c0c3-412e-993e-60285f7cadf2 tempest-TestInstancesWithCinderVolumes-1476682439 None] Deleting attachment 678fb870-6647-43b9-adcb-9a2c412375a5. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:22:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "cinder-5a02ad75-9545-4159-8ce0-035a566b3a1c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-5a02ad75-9545-4159-8ce0-035a566b3a1c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "cinder-quobyte-5a02ad75-9545-4159-8ce0-035a566b3a1c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-quobyte-5a02ad75-9545-4159-8ce0-035a566b3a1c" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7377ff4-32b3-4fd5-b7a1-554428f9fb2b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:01 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c Sep 28 12:22:01 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:01 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c" returned: 0 in 0.581s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:01 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c Sep 28 12:22:01 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:02 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5a02ad75-9545-4159-8ce0-035a566b3a1c" returned: 0 in 0.403s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-quobyte-5a02ad75-9545-4159-8ce0-035a566b3a1c" released by "delete_volume" :: held 1.065s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:02 devstack cinder-volume[87167]: WARNING cinder.quota [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1847181862-1945933284 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1847181862-1945933284, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:22:02 devstack cinder-volume[87167]: WARNING cinder.quota [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1847181862-1945933284 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1847181862-1945933284, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Created reservations ['3bf7d6eb-d98f-4f51-aeb4-5369046f4538', 'e3fa29f8-193e-4a41-bedb-34e1e982b3de', 'f1bba69d-a27b-441d-a15c-2af3d9960bb6', '3434c80a-901b-470e-b8df-ae912a579b9b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:02 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:02 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:02 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.338s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Deleted volume successfully. Sep 28 12:22:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-abd782a6-eb48-49a2-96a2-a811ab108d6d tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-5a02ad75-9545-4159-8ce0-035a566b3a1c-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (85894b85-c71d-4830-8af7-a02cf2c2783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b184ef-6e72-441c-8975-37e132c26f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b184ef-6e72-441c-8975-37e132c26f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1547135990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22eb8921-30c6-4d39-bde9-97cb59368cb7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:03Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2751c8d-1b01-4132-955c-7ed8309b7a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2751c8d-1b01-4132-955c-7ed8309b7a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49018df-d59d-4d66-942b-0bdd6f87c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49018df-d59d-4d66-942b-0bdd6f87c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22eb8921-30c6-4d39-bde9-97cb59368cb7', 'volume_name': 'volume-22eb8921-30c6-4d39-bde9-97cb59368cb7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224548aa-6806-4f98-b057-f903ce4ec148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224548aa-6806-4f98-b057-f903ce4ec148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdc4749-6011-4913-961b-2b7d5724b51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Volume 22eb8921-30c6-4d39-bde9-97cb59368cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22eb8921-30c6-4d39-bde9-97cb59368cb7', 'volume_size': 1} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1547135990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22eb8921-30c6-4d39-bde9-97cb59368cb7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:03Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Creating volume 22eb8921-30c6-4d39-bde9-97cb59368cb7 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:03 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:03 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 1073741824 Sep 28 12:22:03 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Flow 'volume_create_manager' (39272420-8f57-42a6-a880-5fb967d46af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c3ca36-9e24-4266-900d-75f082688510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c3ca36-9e24-4266-900d-75f082688510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-758638567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c538fed-d761-4991-b81c-9ced130bfdd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb23766c6a7246f494dd86af76458681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:03Z,use_quota=True,user_id='aae8d6c236264a489630bf6df47fc7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75839087-d9ef-48fc-be8b-0bb552671847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75839087-d9ef-48fc-be8b-0bb552671847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7360a0f-43a5-49f9-841d-9221651f0e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7360a0f-43a5-49f9-841d-9221651f0e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c538fed-d761-4991-b81c-9ced130bfdd1', 'volume_name': 'volume-4c538fed-d761-4991-b81c-9ced130bfdd1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b170463-c334-43a0-a2a8-968cab2fe3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b170463-c334-43a0-a2a8-968cab2fe3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3c80f5-2f65-4639-80bd-8f9cc39475a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Volume 4c538fed-d761-4991-b81c-9ced130bfdd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c538fed-d761-4991-b81c-9ced130bfdd1', 'volume_size': 1} Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:03 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 1073741824" returned: 0 in 0.614s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:04 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 Sep 28 12:22:04 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:04 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7" returned: 0 in 0.353s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-758638567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c538fed-d761-4991-b81c-9ced130bfdd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb23766c6a7246f494dd86af76458681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:03Z,use_quota=True,user_id='aae8d6c236264a489630bf6df47fc7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Creating volume 4c538fed-d761-4991-b81c-9ced130bfdd1 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdc4749-6011-4913-961b-2b7d5724b51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22eb8921-30c6-4d39-bde9-97cb59368cb7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6277233-ebf2-4b6e-abb5-f719f736a1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:04 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 1073741824 Sep 28 12:22:04 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Volume volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 (22eb8921-30c6-4d39-bde9-97cb59368cb7): created successfully Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6277233-ebf2-4b6e-abb5-f719f736a1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (85894b85-c71d-4830-8af7-a02cf2c2783b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ca55b566-67aa-41c0-b4ba-c54bbb441c64 tempest-VolumesGetTest-1619323689 None] Created volume successfully. Sep 28 12:22:04 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 1073741824" returned: 0 in 0.539s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:05 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 Sep 28 12:22:05 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:05 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1" returned: 0 in 0.362s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3c80f5-2f65-4639-80bd-8f9cc39475a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c538fed-d761-4991-b81c-9ced130bfdd1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14dca39-ed3d-4ab7-b9cf-6237338c2cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Volume volume-4c538fed-d761-4991-b81c-9ced130bfdd1 (4c538fed-d761-4991-b81c-9ced130bfdd1): created successfully Sep 28 12:22:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14dca39-ed3d-4ab7-b9cf-6237338c2cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Flow 'volume_create_manager' (39272420-8f57-42a6-a880-5fb967d46af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-ae89b700-b1b7-4f34-8599-c81802fda378 req-798fee08-b6a7-4341-99ec-70b97c02ed63 tempest-VolumesSnapshotsTestJSON-515272505 None] Created volume successfully. Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Creating offline snapshot 63583dc7-c9fa-4aad-b161-24dfbd32826d of volume 4c538fed-d761-4991-b81c-9ced130bfdd1 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9f9ba9-0636-4c3f-be28-64defb7daea8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:06 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 Sep 28 12:22:06 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-4960dc89-a1da-4699-9848-e9bc9023026f req-e52914d8-4bb5-47be-9630-56f2004aaefc tempest-TestInstancesWithCinderVolumes-1476682439 None] Terminate volume connection completed successfully. Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-4960dc89-a1da-4699-9848-e9bc9023026f req-e52914d8-4bb5-47be-9630-56f2004aaefc tempest-TestInstancesWithCinderVolumes-1476682439 None] Deleting attachment 33d2952b-e893-4076-abd5-9c77b23b841b. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (25b6c335-fffd-4996-9a65-5c2d17a6ccb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa6f3d3-431e-4062-8e82-148bd9a402fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa6f3d3-431e-4062-8e82-148bd9a402fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2005144161',display_name='tempest-VolumesGetTest-Volume-1404448552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e94d43-4189-4ba1-bfaa-00b425b2633e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:06Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4277185f-29e1-428f-abdc-b3e1fa50093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4277185f-29e1-428f-abdc-b3e1fa50093f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f73b25-3469-4de0-909d-e76ad7681ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f73b25-3469-4de0-909d-e76ad7681ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e94d43-4189-4ba1-bfaa-00b425b2633e', 'volume_name': 'volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81f6ea9-aab3-48c0-af8a-c66b86f1ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81f6ea9-aab3-48c0-af8a-c66b86f1ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4c4246-0f0e-4828-a9dd-35866f0410b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Volume d9e94d43-4189-4ba1-bfaa-00b425b2633e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e', 'volume_size': 1} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:06 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1" returned: 0 in 0.490s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:06 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d 1G Sep 28 12:22:06 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "cinder-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "cinder-quobyte-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-quobyte-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[582b9639-5160-4cfb-b6dc-73b0ee9e0be0]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:07 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e Sep 28 12:22:07 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:07 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d 1G" returned: 0 in 0.549s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c538fed-d761-4991-b81c-9ced130bfdd1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:07 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c538fed-d761-4991-b81c-9ced130bfdd1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d Sep 28 12:22:07 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:07 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e" returned: 0 in 0.525s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:07 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e Sep 28 12:22:07 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:07 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c538fed-d761-4991-b81c-9ced130bfdd1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d" returned: 0 in 0.369s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:07 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d is being set with open permissions: ugo+rw Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:07 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d Sep 28 12:22:07 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:07 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e" returned: 0 in 0.315s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-quobyte-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e" released by "delete_volume" :: held 0.898s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:07 devstack cinder-volume[87167]: WARNING cinder.quota [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-664294699-269999734 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-664294699-269999734, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:22:07 devstack cinder-volume[87167]: WARNING cinder.quota [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-664294699-269999734 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-664294699-269999734, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:22:07 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Created reservations ['b14e9c81-60cb-40da-a3fc-419c677d8146', '1abd28a2-eca9-488a-8697-429c265b99f2', '143180ba-b9f5-45e1-baa1-f27ee7aa82b6', 'b780ce6f-74ea-4a56-ad23-5cc0dc23e92b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d" returned: 0 in 0.312s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:07 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.info Sep 28 12:22:07 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:07 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:07 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:08 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.info" returned: 0 in 0.401s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:08 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.info is being set with open permissions: ugo+rw Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:08 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.365s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:08 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.info Sep 28 12:22:08 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Deleted volume successfully. Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b0b77b3c-3290-448a-93ee-4fb115543952 tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-cb7d7ffc-435e-47e6-8f9f-abcebd5b375e-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:08 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.info" returned: 0 in 0.420s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2005144161',display_name='tempest-VolumesGetTest-Volume-1404448552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e94d43-4189-4ba1-bfaa-00b425b2633e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:06Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Creating volume d9e94d43-4189-4ba1-bfaa-00b425b2633e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:08 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:22:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:08 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e 1073741824 Sep 28 12:22:08 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-7a65597f-6e5a-4e0f-b259-926084ff5352 req-5671e7b9-ac62-4d9b-b602-2a99c771f62f tempest-VolumesSnapshotsTestJSON-515272505 None] Create snapshot completed successfully Sep 28 12:22:09 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e 1073741824" returned: 0 in 0.597s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:09 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e Sep 28 12:22:09 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "cinder-63583dc7-c9fa-4aad-b161-24dfbd32826d-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-63583dc7-c9fa-4aad-b161-24dfbd32826d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "cinder-quobyte-4c538fed-d761-4991-b81c-9ced130bfdd1" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-quobyte-4c538fed-d761-4991-b81c-9ced130bfdd1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "cinder-quobyte-63583dc7-c9fa-4aad-b161-24dfbd32826d" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-quobyte-63583dc7-c9fa-4aad-b161-24dfbd32826d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Deleting offline snapshot 63583dc7-c9fa-4aad-b161-24dfbd32826d of volume 4c538fed-d761-4991-b81c-9ced130bfdd1 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:22:09 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] snapshot_file for this snap is: volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e" returned: 0 in 0.329s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec5cfa4-f4fc-4f2d-975b-64fc29694a73]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4c4246-0f0e-4828-a9dd-35866f0410b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf044373-d42f-4bb6-829a-e701c6db15a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Volume volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e (d9e94d43-4189-4ba1-bfaa-00b425b2633e): created successfully Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf044373-d42f-4bb6-829a-e701c6db15a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (25b6c335-fffd-4996-9a65-5c2d17a6ccb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-07dd3b53-d832-4715-a931-702bd1197725 tempest-VolumesGetTest-1619323689 None] Created volume successfully. Sep 28 12:22:09 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d Sep 28 12:22:09 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:10 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d" returned: 0 in 0.525s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c538fed-d761-4991-b81c-9ced130bfdd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:22:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3592a99b-f217-490b-b2d2-f81900031943]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:10 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 Sep 28 12:22:10 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:10 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1" returned: 0 in 0.582s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:10 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d Sep 28 12:22:10 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-d9e94d43-4189-4ba1-bfaa-00b425b2633e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Lock "cinder-d9e94d43-4189-4ba1-bfaa-00b425b2633e-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-d9e94d43-4189-4ba1-bfaa-00b425b2633e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-d9e94d43-4189-4ba1-bfaa-00b425b2633e" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf4127-bf13-4c2b-9b9a-920def72a0f4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:11 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e Sep 28 12:22:11 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:11 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d" returned: 0 in 0.674s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:11 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d Sep 28 12:22:11 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:11 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e" returned: 0 in 0.577s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:11 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e Sep 28 12:22:11 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:12 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1.63583dc7-c9fa-4aad-b161-24dfbd32826d" returned: 0 in 0.491s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-quobyte-63583dc7-c9fa-4aad-b161-24dfbd32826d" released by "_delete_snapshot" :: held 2.460s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-quobyte-4c538fed-d761-4991-b81c-9ced130bfdd1" released by "delete_snapshot" :: held 2.498s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.quota [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Created reservations ['7f3aa16a-966d-455c-8c35-edf6733af5a4', '43f9e238-4477-49ec-a163-1c6c733470f0', 'a016bc65-49ba-40ba-b573-4739bb9dc45f', '4b7cb90b-5875-47c2-aa29-46fc35f26b46'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:12 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d9e94d43-4189-4ba1-bfaa-00b425b2633e" returned: 0 in 0.338s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-d9e94d43-4189-4ba1-bfaa-00b425b2633e" released by "delete_volume" :: held 0.983s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Delete snapshot completed successfully. Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-b9e6a954-b03e-484a-8c88-62f30e7772cd req-e2ed0419-39ab-4cb1-af3f-9be98339d6d9 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-63583dc7-c9fa-4aad-b161-24dfbd32826d-delete_snapshot" released by "delete_snapshot" :: held 2.740s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Created reservations ['f144ecb5-ffaa-464b-b056-2eb628c4661b', '5334a9b9-a7e9-451f-928e-3605e7dee3ed', '5187fe5a-201b-41bc-b0e2-5036ad013b65', '1df5f644-57b7-4f95-a49a-37cc214a975e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:12 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:12 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-044b733f-98d6-4970-8952-9dc525a4b2ad req-aaa50f2e-a658-40e9-a138-36513a906253 tempest-TestInstancesWithCinderVolumes-1476682439 None] Terminate volume connection completed successfully. Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-044b733f-98d6-4970-8952-9dc525a4b2ad req-aaa50f2e-a658-40e9-a138-36513a906253 tempest-TestInstancesWithCinderVolumes-1476682439 None] Deleting attachment 1a75ce17-5c91-491f-b804-da2a5a813590. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:22:12 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.320s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Deleted volume successfully. Sep 28 12:22:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-027a8a01-c4fa-458c-a824-64f35972a7ac tempest-VolumesGetTest-1619323689 None] Lock "cinder-d9e94d43-4189-4ba1-bfaa-00b425b2633e-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "cinder-4c538fed-d761-4991-b81c-9ced130bfdd1-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-4c538fed-d761-4991-b81c-9ced130bfdd1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "cinder-quobyte-4c538fed-d761-4991-b81c-9ced130bfdd1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-quobyte-4c538fed-d761-4991-b81c-9ced130bfdd1" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b38c1-c6dd-464a-922a-b8e3fee5bf6c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:13 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 Sep 28 12:22:13 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-22eb8921-30c6-4d39-bde9-97cb59368cb7-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Lock "cinder-22eb8921-30c6-4d39-bde9-97cb59368cb7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-22eb8921-30c6-4d39-bde9-97cb59368cb7" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-22eb8921-30c6-4d39-bde9-97cb59368cb7" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d136e24-0623-464c-8009-49d6b193c3d4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:13 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1" returned: 0 in 0.493s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:13 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1 Sep 28 12:22:13 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:13 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 Sep 28 12:22:13 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:14 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4c538fed-d761-4991-b81c-9ced130bfdd1" returned: 0 in 0.339s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-quobyte-4c538fed-d761-4991-b81c-9ced130bfdd1" released by "delete_volume" :: held 0.935s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:14 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7" returned: 0 in 0.471s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:14 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7 Sep 28 12:22:14 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.quota [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Created reservations ['f8c92100-190f-4141-a49a-9ce617844cd4', '88992e82-d89a-4a95-af6c-d371ea986566', 'c98e6def-59d1-44cf-9f0c-07fd216710d4', 'e1ed4a0b-8ff7-4e54-bda8-f8a62067bfb3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:14 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:14 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "cinder-90ebfcb6-8900-4682-a462-be490c93966b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-90ebfcb6-8900-4682-a462-be490c93966b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:14 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-22eb8921-30c6-4d39-bde9-97cb59368cb7" returned: 0 in 0.376s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-22eb8921-30c6-4d39-bde9-97cb59368cb7" released by "delete_volume" :: held 0.912s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "cinder-quobyte-90ebfcb6-8900-4682-a462-be490c93966b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-quobyte-90ebfcb6-8900-4682-a462-be490c93966b" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b691f-cfe0-4ed5-87a3-fbeb9caa0ae8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Created reservations ['6cb43008-0aa2-4768-899a-c6eac26e30a9', 'ee317a5e-e55f-47ea-8301-8fd2d886c7f6', '3cee9e48-101c-462c-b812-973431198d75', 'd4e2a1b9-68a0-4c95-9f8f-83f7f68e30b5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:14 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.521s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.manager [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Deleted volume successfully. Sep 28 12:22:14 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b Sep 28 12:22:14 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-75c34acf-991e-403f-b7e2-24a3333b1e76 req-667aabba-7820-4fcb-baf5-e02db3a14139 tempest-VolumesSnapshotsTestJSON-515272505 None] Lock "cinder-4c538fed-d761-4991-b81c-9ced130bfdd1-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:14 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:14 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:15 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b" returned: 0 in 0.501s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:15 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b Sep 28 12:22:15 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:15 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Deleted volume successfully. Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-068c224c-73b3-4c47-9e6f-79918cb8b047 tempest-VolumesGetTest-1619323689 None] Lock "cinder-22eb8921-30c6-4d39-bde9-97cb59368cb7-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:15 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-90ebfcb6-8900-4682-a462-be490c93966b" returned: 0 in 0.301s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-quobyte-90ebfcb6-8900-4682-a462-be490c93966b" released by "delete_volume" :: held 0.896s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:15 devstack cinder-volume[87167]: WARNING cinder.quota [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220344658-238144603 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220344658-238144603, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:22:15 devstack cinder-volume[87167]: WARNING cinder.quota [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220344658-238144603 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1220344658-238144603, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Created reservations ['f3f42b8f-62ba-40d6-954e-aab7eb34df09', '0f8c88f2-e0f3-4376-b869-2e636f1f5d62', '0231f93b-4da0-4144-8024-2775237d8b2c', 'd712b04a-7e9a-4ee9-a35b-139be54a9d50'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:15 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:15 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:16 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.368s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Deleted volume successfully. Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2466fc29-9b2a-4578-b3fb-c3405d958aba tempest-TestInstancesWithCinderVolumes-1476682439 None] Lock "cinder-90ebfcb6-8900-4682-a462-be490c93966b-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (46be7dba-599c-4b50-ae8d-03275b3e74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4eb3e1-b45e-46f6-acc2-7baaf6849e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4eb3e1-b45e-46f6-acc2-7baaf6849e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1840207159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f9f057-e82e-40b6-b16c-7a6ce3bcd976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:16Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db388c24-8ace-491d-99a3-1e92b7940957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db388c24-8ace-491d-99a3-1e92b7940957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d9204c-7a11-4e53-9582-26760cb53935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d9204c-7a11-4e53-9582-26760cb53935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f9f057-e82e-40b6-b16c-7a6ce3bcd976', 'volume_name': 'volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee271bd-66b5-4f8f-83ee-083f071e8c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee271bd-66b5-4f8f-83ee-083f071e8c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d27fb6d-6690-44e4-963d-cfe6fada043f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Volume 38f9f057-e82e-40b6-b16c-7a6ce3bcd976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976', 'volume_size': 1} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1840207159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f9f057-e82e-40b6-b16c-7a6ce3bcd976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:16Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Creating volume 38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:16 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:22:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:16 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 1073741824 Sep 28 12:22:16 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:17 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 1073741824" returned: 0 in 0.697s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:17 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 Sep 28 12:22:17 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:17 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d27fb6d-6690-44e4-963d-cfe6fada043f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d408b1c-03a9-402e-b1a7-bcfe641bef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Volume volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 (38f9f057-e82e-40b6-b16c-7a6ce3bcd976): created successfully Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d408b1c-03a9-402e-b1a7-bcfe641bef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (46be7dba-599c-4b50-ae8d-03275b3e74fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2c2e6f7-705f-4750-8d57-dd6a1778b136 tempest-VolumesGetTest-1619323689 None] Created volume successfully. Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (1999192c-4e41-4c1d-a892-eb0923d355c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0ef5ec-5e6b-4195-88b2-b880476b5d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0ef5ec-5e6b-4195-88b2-b880476b5d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-598193500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d57aa1a-efaf-437a-9ad5-ba8695872cb9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=38f9f057-e82e-40b6-b16c-7a6ce3bcd976,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:19Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76872008-3b8b-4723-95d6-47081fd8cc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76872008-3b8b-4723-95d6-47081fd8cc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f2744b-41ed-409f-8677-b5c5978a53d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f2744b-41ed-409f-8677-b5c5978a53d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4d57aa1a-efaf-437a-9ad5-ba8695872cb9', 'volume_name': 'volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9', 'volume_size': 1, 'source_volid': '38f9f057-e82e-40b6-b16c-7a6ce3bcd976', 'source_volstatus': 'available'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89e0b27-19c7-403c-8599-afd8c5c4118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89e0b27-19c7-403c-8599-afd8c5c4118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9875b455-481e-4377-b419-86e3fe4759b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:19 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Volume 4d57aa1a-efaf-437a-9ad5-ba8695872cb9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9', 'volume_size': 1, 'source_volid': '38f9f057-e82e-40b6-b16c-7a6ce3bcd976', 'source_volstatus': 'available'} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:19 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Cloning volume 38f9f057-e82e-40b6-b16c-7a6ce3bcd976 to volume 4d57aa1a-efaf-437a-9ad5-ba8695872cb9 Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Creating offline snapshot ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 of volume 38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cbaeae-f4ef-4bfb-991a-c1084b3a3df6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:19 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 Sep 28 12:22:19 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:20 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" returned: 0 in 0.518s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:20 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 1G Sep 28 12:22:20 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Flow 'volume_create_manager' (84fc03fa-eaf4-46c7-b935-bb7f8dae923b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4565316b-6cd0-464c-81db-548742f89a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4565316b-6cd0-464c-81db-548742f89a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1704206212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f546f307-7a58-42ab-a444-995ea5678746,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b7aef435d434bd68129b7cb63c3d8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:20Z,use_quota=True,user_id='5911207410f34d24b8bdb96babd3856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d7da8b-7d3d-4a06-b587-389c1f7e56d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d7da8b-7d3d-4a06-b587-389c1f7e56d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0d2762-5edd-4958-b685-60ae96b8aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0d2762-5edd-4958-b685-60ae96b8aa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f546f307-7a58-42ab-a444-995ea5678746', 'volume_name': 'volume-f546f307-7a58-42ab-a444-995ea5678746', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851a5901-99c7-4e63-bfa0-22710ff87525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851a5901-99c7-4e63-bfa0-22710ff87525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e302135a-6d00-437b-be87-3254d85249a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Volume f546f307-7a58-42ab-a444-995ea5678746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f546f307-7a58-42ab-a444-995ea5678746', 'volume_size': 1} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:20 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 1G" returned: 0 in 0.537s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:20 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 Sep 28 12:22:20 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:21 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" returned: 0 in 0.377s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:21 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 is being set with open permissions: ugo+rw Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:21 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 Sep 28 12:22:21 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:21 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" returned: 0 in 0.274s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:21 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.info Sep 28 12:22:21 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:21 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.info" returned: 0 in 0.272s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:21 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.info is being set with open permissions: ugo+rw Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:21 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.info Sep 28 12:22:21 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:21 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.info" returned: 0 in 0.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] snapshot: ed774916-5e89-4cf6-8c22-7ea4bfe30ee7, volume: 4d57aa1a-efaf-437a-9ad5-ba8695872cb9, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0019841-f70c-46b4-b7d7-542a30cbf5cf]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:22 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 Sep 28 12:22:22 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:22 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" returned: 0 in 0.544s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[071fc7fb-213d-428d-96f4-88f2a41c2b3b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:22 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 Sep 28 12:22:22 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:23 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" returned: 0 in 0.495s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:22:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:22:23 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:22:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:23 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 Sep 28 12:22:23 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:30 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" returned: 0 in 7.812s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:30 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976, size 1024.00 MB, duration 7.81 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:22:30 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Converted 1024.00 MB image at 131.06 MB/s Sep 28 12:22:30 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 is being set with open permissions: ugo+rw Sep 28 12:22:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:30 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 Sep 28 12:22:30 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:31 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" returned: 0 in 0.287s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" released by "_copy_volume_from_snapshot" :: held 9.238s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=165,cinder:INSERT=39,cinder:SELECT=119,cinder:DELETE=14 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Deleting offline snapshot ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 of volume 38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] snapshot_file for this snap is: volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eab5a7-6250-4cfc-be82-696571a7875e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=143,cinder:UPDATE=150,cinder:DELETE=10,cinder:INSERT=37 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:22:31 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 Sep 28 12:22:31 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:31 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" returned: 0 in 0.442s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[54afd961-74b2-4bb4-86ab-201232c4c1f6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:31 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 Sep 28 12:22:31 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:32 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" returned: 0 in 0.557s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:32 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 Sep 28 12:22:32 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:32 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" returned: 0 in 0.373s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:32 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7 Sep 28 12:22:32 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:33 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976.ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" returned: 0 in 0.289s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-ed774916-5e89-4cf6-8c22-7ea4bfe30ee7" released by "_delete_snapshot" :: held 1.795s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.584s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.711s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1704206212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f546f307-7a58-42ab-a444-995ea5678746,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1b7aef435d434bd68129b7cb63c3d8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:20Z,use_quota=True,user_id='5911207410f34d24b8bdb96babd3856e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Creating volume f546f307-7a58-42ab-a444-995ea5678746 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:33 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 1073741824 Sep 28 12:22:33 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9875b455-481e-4377-b419-86e3fe4759b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9', 'volume_size': 1, 'source_volid': '38f9f057-e82e-40b6-b16c-7a6ce3bcd976', 'source_volstatus': 'available'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412d12f8-781f-4545-8874-05bcf47b0e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Volume volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 (4d57aa1a-efaf-437a-9ad5-ba8695872cb9): created successfully Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412d12f8-781f-4545-8874-05bcf47b0e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (1999192c-4e41-4c1d-a892-eb0923d355c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-43bad342-1b4d-4a92-8ea3-a3a1d2664cf7 tempest-VolumesGetTest-1619323689 None] Created volume successfully. Sep 28 12:22:33 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 1073741824" returned: 0 in 0.500s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:33 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 Sep 28 12:22:33 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:33 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746" returned: 0 in 0.310s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e302135a-6d00-437b-be87-3254d85249a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f546f307-7a58-42ab-a444-995ea5678746', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73f387e-f43c-4fa3-8df7-9ca5ccc8c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Volume volume-f546f307-7a58-42ab-a444-995ea5678746 (f546f307-7a58-42ab-a444-995ea5678746): created successfully Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73f387e-f43c-4fa3-8df7-9ca5ccc8c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Flow 'volume_create_manager' (84fc03fa-eaf4-46c7-b935-bb7f8dae923b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-a8321285-037d-432f-84e5-99ef8dc11244 req-227ef92c-8c3d-4d1a-8937-2d42c80f2829 tempest-VolumesGetTestJSON-626675842 None] Created volume successfully. Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (1303c992-929a-46d3-835e-8e44506f974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7fc8be-d2f9-47e0-baee-262252ae5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7fc8be-d2f9-47e0-baee-262252ae5969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1002331309',display_name='tempest-VolumesGetTest-Volume-220425173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b702f3ed-87d0-4d09-aa9f-515e4a243903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:35Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de379fd-d4e4-470e-8e0d-a09e44a19d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de379fd-d4e4-470e-8e0d-a09e44a19d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d512173b-d723-4dae-9be1-c31f581f2df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d512173b-d723-4dae-9be1-c31f581f2df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b702f3ed-87d0-4d09-aa9f-515e4a243903', 'volume_name': 'volume-b702f3ed-87d0-4d09-aa9f-515e4a243903', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1051103-4a57-44e6-b16a-e811ad582f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1051103-4a57-44e6-b16a-e811ad582f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d9eb1e-6158-455c-9a4e-c7c70e6aa5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Volume b702f3ed-87d0-4d09-aa9f-515e4a243903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b702f3ed-87d0-4d09-aa9f-515e4a243903', 'volume_size': 1} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1002331309',display_name='tempest-VolumesGetTest-Volume-220425173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b702f3ed-87d0-4d09-aa9f-515e4a243903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:35Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Creating volume b702f3ed-87d0-4d09-aa9f-515e4a243903 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:34 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:22:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:34 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 1073741824 Sep 28 12:22:34 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:35 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 1073741824" returned: 0 in 0.547s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:35 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 Sep 28 12:22:35 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Acquiring lock "cinder-f546f307-7a58-42ab-a444-995ea5678746-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Lock "cinder-f546f307-7a58-42ab-a444-995ea5678746-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Acquiring lock "cinder-quobyte-f546f307-7a58-42ab-a444-995ea5678746" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Lock "cinder-quobyte-f546f307-7a58-42ab-a444-995ea5678746" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:35 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903" returned: 0 in 0.293s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e0c41b-c5be-4443-b284-f4eb1df9ecf5]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d9eb1e-6158-455c-9a4e-c7c70e6aa5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b702f3ed-87d0-4d09-aa9f-515e4a243903', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8abd0c3a-b4f9-4aa0-b025-af57713118e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Volume volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 (b702f3ed-87d0-4d09-aa9f-515e4a243903): created successfully Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8abd0c3a-b4f9-4aa0-b025-af57713118e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (1303c992-929a-46d3-835e-8e44506f974d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-39163abc-e354-4b14-9263-f9808778efb5 tempest-VolumesGetTest-1619323689 None] Created volume successfully. Sep 28 12:22:35 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 Sep 28 12:22:35 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:36 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746" returned: 0 in 0.435s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:36 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746 Sep 28 12:22:36 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:36 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f546f307-7a58-42ab-a444-995ea5678746" returned: 0 in 0.266s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Lock "cinder-quobyte-f546f307-7a58-42ab-a444-995ea5678746" released by "delete_volume" :: held 0.788s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG cinder.quota [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Created reservations ['bc02eb90-f737-4864-9197-4bb995d3e34e', 'c2c9f2bf-5472-4708-bfa8-0077d6d1fbce', 'badc8cd9-481c-4984-9cec-d2a28a9de074', '6f0faaa4-a15f-4c65-8111-f09fd15a9207'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:36 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:36 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:36 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.349s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG cinder.manager [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Deleted volume successfully. Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [req-28e693df-f037-41d4-a914-5a0e7f1f7556 req-7eaf1516-6760-4fe8-b9b7-d283a4f9e28f tempest-VolumesGetTestJSON-626675842 None] Lock "cinder-f546f307-7a58-42ab-a444-995ea5678746-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-b702f3ed-87d0-4d09-aa9f-515e4a243903-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Lock "cinder-b702f3ed-87d0-4d09-aa9f-515e4a243903-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-b702f3ed-87d0-4d09-aa9f-515e4a243903" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-b702f3ed-87d0-4d09-aa9f-515e4a243903" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aa8158-e0e9-4189-a4c6-b3d764c8b877]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:37 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 Sep 28 12:22:37 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:37 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903" returned: 0 in 0.484s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:37 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903 Sep 28 12:22:37 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:37 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b702f3ed-87d0-4d09-aa9f-515e4a243903" returned: 0 in 0.303s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-b702f3ed-87d0-4d09-aa9f-515e4a243903" released by "delete_volume" :: held 0.844s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Created reservations ['f822facb-a4c2-42f8-996a-4f0633c0e624', 'd6d6c20f-b919-486d-935b-87e633cd1ef8', 'a732b250-7d22-4f9a-9688-5bb9b9f7e235', 'c2bed13b-7dbe-4690-b321-47eb6713635e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:38 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:38 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-4d57aa1a-efaf-437a-9ad5-ba8695872cb9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Lock "cinder-4d57aa1a-efaf-437a-9ad5-ba8695872cb9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:38 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.315s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Deleted volume successfully. Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04881f3-57fa-4032-9eca-50799ddc1c28]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3bb78253-b225-4071-839a-96557526c3eb tempest-VolumesGetTest-1619323689 None] Lock "cinder-b702f3ed-87d0-4d09-aa9f-515e4a243903-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:38 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 Sep 28 12:22:38 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:38 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" returned: 0 in 0.469s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:38 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9 Sep 28 12:22:38 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:39 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-4d57aa1a-efaf-437a-9ad5-ba8695872cb9" released by "delete_volume" :: held 0.873s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Created reservations ['9b2b2fe6-e464-4f84-8912-f66ab59ec838', '9234fad5-fe7e-460d-8df3-a6bb8a8f150a', '147aafbe-8779-4b8e-a308-19703bcddfa2', '3cbd97cd-b2e4-4cb7-bce7-26bc9cf1b702'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:39 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:39 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-38f9f057-e82e-40b6-b16c-7a6ce3bcd976-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Lock "cinder-38f9f057-e82e-40b6-b16c-7a6ce3bcd976-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8290b0-e0eb-4cea-a76b-114c1f3e53c8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:39 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.475s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Deleted volume successfully. Sep 28 12:22:39 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 Sep 28 12:22:39 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b86d92b5-8408-438f-ad30-c37d76ad6400 tempest-VolumesGetTest-1619323689 None] Lock "cinder-4d57aa1a-efaf-437a-9ad5-ba8695872cb9-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:40 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" returned: 0 in 0.422s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:40 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976 Sep 28 12:22:40 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:40 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" returned: 0 in 0.451s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-38f9f057-e82e-40b6-b16c-7a6ce3bcd976" released by "delete_volume" :: held 1.010s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Created reservations ['111eb27c-f1ac-4274-a276-7afb4591c59f', '977038ec-5eb9-42fc-b8c7-a9d08dcf5e9a', '41670731-701f-422c-9483-3ab6f7478933', '58c7a646-7c78-4102-b1f6-e25029b4ab07'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:40 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:40 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:41 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.330s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Deleted volume successfully. Sep 28 12:22:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-315c98b3-2fe9-4d35-8ee3-a793c9253a60 tempest-VolumesGetTest-1619323689 None] Lock "cinder-38f9f057-e82e-40b6-b16c-7a6ce3bcd976-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4308186f-9d8f-4ebf-978a-6b9585fa9410 tempest-BackendsCapabilitiesAdminTestsJSON-1315614181 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.200527191162, 'free_capacity_gb': 1775.200527191162, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 12:22:42 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b3bc2de8-634b-47c0-baef-09296bc919bc tempest-BackendsCapabilitiesAdminTestsJSON-1315614181 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.200527191162, 'free_capacity_gb': 1775.200527191162, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 12:22:43 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (cca5abaf-0848-4083-a5a5-c81324a5832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61f9b22-a091-4d67-8b93-3f867eaeff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61f9b22-a091-4d67-8b93-3f867eaeff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-810860973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5a00c9-c4d1-4d41-baf1-4292a99410f5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:43Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99dccbbe-3eb2-4d7e-93ec-5b701f15c2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99dccbbe-3eb2-4d7e-93ec-5b701f15c2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad16be40-bf18-4e36-8aca-9b0ffb4a905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:43 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:22:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad16be40-bf18-4e36-8aca-9b0ffb4a905a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff5a00c9-c4d1-4d41-baf1-4292a99410f5', 'volume_name': 'volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58aa6a3-5036-4aa2-9808-67a62e0e04ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58aa6a3-5036-4aa2-9808-67a62e0e04ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:44 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a28861e-588d-41f0-a591-e562e2706296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:44 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Volume ff5a00c9-c4d1-4d41-baf1-4292a99410f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:22:44 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Trying to clone ff5a00c9-c4d1-4d41-baf1-4292a99410f5 from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:22:44 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:22:44 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:22:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0a2ab4-5e28-4ad2-a8be-99e7041b78ef]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:44 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD Sep 28 12:22:44 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:45 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a is fetched for user b7de1baf66684221b95074b7c724386c. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb3680f-5fb9-4dd3-b637-fae70fe09536]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:45 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD Sep 28 12:22:45 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:45 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-810860973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5a00c9-c4d1-4d41-baf1-4292a99410f5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:43Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Creating volume ff5a00c9-c4d1-4d41-baf1-4292a99410f5 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:45 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:22:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:45 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 1073741824 Sep 28 12:22:45 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:46 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 1073741824" returned: 0 in 0.680s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:46 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 Sep 28 12:22:46 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:47 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5" returned: 0 in 0.396s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Attempting download of 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume ff5a00c9-c4d1-4d41-baf1-4292a99410f5. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3081e00c-c8fc-44fb-b4ba-93b14c446d12]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_7e_tm2d2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:47 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_7e_tm2d2 Sep 28 12:22:47 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:47 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_7e_tm2d2" returned: 0 in 0.418s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_7e_tm2d2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:47 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_7e_tm2d2 Sep 28 12:22:47 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:47 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_7e_tm2d2" returned: 1 in 0.407s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1001d1e1-2632-478f-a3a3-396a6f86ff9a_7e_tm2d2' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[318dc623-f525-4146-a08d-0046babc8d13]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:48 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD Sep 28 12:22:48 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:48 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:48 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] 1001d1e1-2632-478f-a3a3-396a6f86ff9a was qcow2, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:22:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:48 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 Sep 28 12:22:48 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:49 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:49 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:49 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.379s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:22:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:22:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-af9477bd-efc2-4224-8a77-9156fd57b204 tempest-GroupsV320Test-1733715012 None] Group tempest-GroupsV320Test-Group-1344863141: creating Sep 28 12:22:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-af9477bd-efc2-4224-8a77-9156fd57b204 tempest-GroupsV320Test-1733715012 None] Group tempest-GroupsV320Test-Group-1344863141: created successfully Sep 28 12:22:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-af9477bd-efc2-4224-8a77-9156fd57b204 tempest-GroupsV320Test-1733715012 None] Create group completed successfully. Sep 28 12:22:51 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5" returned: 0 in 2.733s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1001d1e1-2632-478f-a3a3-396a6f86ff9a_eg1wgu77devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:22:51 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Converted 112.00 MB image at 40.97 MB/s Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:51 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 1G Sep 28 12:22:51 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:51 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 1G" returned: 0 in 0.459s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Downloaded image 1001d1e1-2632-478f-a3a3-396a6f86ff9a ((None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}])) to volume ff5a00c9-c4d1-4d41-baf1-4292a99410f5 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Temporary image 1001d1e1-2632-478f-a3a3-396a6f86ff9a for user b7de1baf66684221b95074b7c724386c is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Marking volume ff5a00c9-c4d1-4d41-baf1-4292a99410f5 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Copying metadata from image 1001d1e1-2632-478f-a3a3-396a6f86ff9a to ff5a00c9-c4d1-4d41-baf1-4292a99410f5. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Creating volume glance metadata for volume ff5a00c9-c4d1-4d41-baf1-4292a99410f5 backed by image 1001d1e1-2632-478f-a3a3-396a6f86ff9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a28861e-588d-41f0-a591-e562e2706296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5', 'volume_size': 1, 'image_id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '492199b1506c4ff4bf6412435d9b3c3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1001d1e1-2632-478f-a3a3-396a6f86ff9a', 'created_at': datetime.datetime(2026, 9, 28, 10, 4, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 4, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1001d1e1-2632-478f-a3a3-396a6f86ff9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d90214-1790-43b8-a963-b9a1d14363de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Volume volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 (ff5a00c9-c4d1-4d41-baf1-4292a99410f5): created successfully Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d90214-1790-43b8-a963-b9a1d14363de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (cca5abaf-0848-4083-a5a5-c81324a5832e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-49572bb6-4a12-4d93-84bd-fd59c95d79b0 tempest-VolumesGetTest-1619323689 None] Created volume successfully. Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Created reservations ['76371e46-1566-4307-abb0-2f63a33e766e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:52 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:52 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:52 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.271s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2bc533e7-6caf-4fbf-942d-0ab6cbee06db tempest-GroupsV320Test-1733715012 None] Delete group completed successfully. Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (82d240bc-157e-49d5-999c-379bf57595b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10274f31-b645-4b54-8418-1bfced6ce5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10274f31-b645-4b54-8418-1bfced6ce5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1623380382',display_name='tempest-VolumesGetTest-Volume-1172922529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c1f2e5-6c5f-460d-aa72-072147193efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:53Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a82f3af-aac3-4565-a200-272198e592a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a82f3af-aac3-4565-a200-272198e592a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8240c933-0570-415e-8286-f59d8f3d9779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8240c933-0570-415e-8286-f59d8f3d9779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c1f2e5-6c5f-460d-aa72-072147193efe', 'volume_name': 'volume-a1c1f2e5-6c5f-460d-aa72-072147193efe', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95356431-b70c-4d17-9670-03e0cfc2b2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95356431-b70c-4d17-9670-03e0cfc2b2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6272162a-ab1f-4150-8483-fade4171abb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:52 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Volume a1c1f2e5-6c5f-460d-aa72-072147193efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c1f2e5-6c5f-460d-aa72-072147193efe', 'volume_size': 1} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1623380382',display_name='tempest-VolumesGetTest-Volume-1172922529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c1f2e5-6c5f-460d-aa72-072147193efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2a98e1bdb5f408e99312d3324f544ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:53Z,use_quota=True,user_id='b7de1baf66684221b95074b7c724386c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Creating volume a1c1f2e5-6c5f-460d-aa72-072147193efe {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:52 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:22:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:52 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe 1073741824 Sep 28 12:22:52 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:53 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe 1073741824" returned: 0 in 0.584s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:53 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe Sep 28 12:22:53 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:53 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe" returned: 0 in 0.330s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6272162a-ab1f-4150-8483-fade4171abb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c1f2e5-6c5f-460d-aa72-072147193efe', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f31c32-29c4-4188-b1b9-555f979058f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:53 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Volume volume-a1c1f2e5-6c5f-460d-aa72-072147193efe (a1c1f2e5-6c5f-460d-aa72-072147193efe): created successfully Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f31c32-29c4-4188-b1b9-555f979058f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Flow 'volume_create_manager' (82d240bc-157e-49d5-999c-379bf57595b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a8447935-2a0f-44ed-adaf-ffea73d1c1d9 tempest-VolumesGetTest-1619323689 None] Created volume successfully. Sep 28 12:22:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-a1c1f2e5-6c5f-460d-aa72-072147193efe-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Lock "cinder-a1c1f2e5-6c5f-460d-aa72-072147193efe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-a1c1f2e5-6c5f-460d-aa72-072147193efe" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-a1c1f2e5-6c5f-460d-aa72-072147193efe" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec6930-6840-4d32-a1fe-0253b5698805]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:55 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe Sep 28 12:22:55 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:55 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe" returned: 0 in 0.462s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:55 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe Sep 28 12:22:55 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:56 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a1c1f2e5-6c5f-460d-aa72-072147193efe" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-a1c1f2e5-6c5f-460d-aa72-072147193efe" released by "delete_volume" :: held 0.834s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Created reservations ['abe021ee-c1ad-4445-9fb1-b78af1e1a249', '8598146b-cc29-4ce4-a83e-9f000e54b60b', 'fdc5cc3d-7e48-4b40-bff9-d04713e7a2d5', 'e35f1c86-2316-4f6e-aa00-b0b8d8df26d8'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:56 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:56 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-ff5a00c9-c4d1-4d41-baf1-4292a99410f5-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Lock "cinder-ff5a00c9-c4d1-4d41-baf1-4292a99410f5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Acquiring lock "cinder-quobyte-ff5a00c9-c4d1-4d41-baf1-4292a99410f5" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-ff5a00c9-c4d1-4d41-baf1-4292a99410f5" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdce589-7ea8-45a8-bf65-623214555590]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:56 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.426s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Deleted volume successfully. Sep 28 12:22:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-df182887-2787-496b-abf3-e10d28e3a9a7 tempest-VolumesGetTest-1619323689 None] Lock "cinder-a1c1f2e5-6c5f-460d-aa72-072147193efe-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:56 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 Sep 28 12:22:56 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:57 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5" returned: 0 in 0.525s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:57 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5 Sep 28 12:22:57 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:57 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ff5a00c9-c4d1-4d41-baf1-4292a99410f5" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Lock "cinder-quobyte-ff5a00c9-c4d1-4d41-baf1-4292a99410f5" released by "delete_volume" :: held 0.990s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Created reservations ['826a6c64-4a5b-4864-bc99-bfe613911b9c', '971a2c14-6a09-44b6-b2d7-5ef584113b05', 'c1961fbe-02f0-44fb-a3f8-ed0a7ca83ad5', '4c737cc2-b119-4feb-acba-5222004df44f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:57 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:22:57 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:58 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.374s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:58 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Deleted volume successfully. Sep 28 12:22:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-642d18a6-e723-4b2d-b893-51d072e849cb tempest-VolumesGetTest-1619323689 None] Lock "cinder-ff5a00c9-c4d1-4d41-baf1-4292a99410f5-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Flow 'volume_create_manager' (150d08e0-53be-4a69-bc63-6235e7b144cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9ebf74-3f7d-4713-81f8-6bec09e8cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9ebf74-3f7d-4713-81f8-6bec09e8cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1182627154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8e31ac-8422-4613-a60c-c1763311a3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0c7f07ec724577a117c47ab50c518d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:01Z,use_quota=True,user_id='c9a8799f9d9a4a569cd6742f1f315de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c524c4-14e7-4b76-a8d7-d7a8b6636d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c524c4-14e7-4b76-a8d7-d7a8b6636d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3dbb18-8660-4bb5-b01c-0427bc4c3128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3dbb18-8660-4bb5-b01c-0427bc4c3128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f8e31ac-8422-4613-a60c-c1763311a3b1', 'volume_name': 'volume-8f8e31ac-8422-4613-a60c-c1763311a3b1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefcf203-e144-499f-b74d-68a83545bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefcf203-e144-499f-b74d-68a83545bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98134e23-380e-467c-889e-6ee963d86fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Volume 8f8e31ac-8422-4613-a60c-c1763311a3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f8e31ac-8422-4613-a60c-c1763311a3b1', 'volume_size': 1} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1182627154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8e31ac-8422-4613-a60c-c1763311a3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0c7f07ec724577a117c47ab50c518d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:01Z,use_quota=True,user_id='c9a8799f9d9a4a569cd6742f1f315de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Creating volume 8f8e31ac-8422-4613-a60c-c1763311a3b1 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:01 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:23:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:01 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 1073741824 Sep 28 12:23:01 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:02 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 1073741824" returned: 0 in 0.513s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:02 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 Sep 28 12:23:02 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:02 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1" returned: 0 in 0.297s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98134e23-380e-467c-889e-6ee963d86fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f8e31ac-8422-4613-a60c-c1763311a3b1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33b3ba2-394e-411a-a1fd-44cc2d70101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Volume volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 (8f8e31ac-8422-4613-a60c-c1763311a3b1): created successfully Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33b3ba2-394e-411a-a1fd-44cc2d70101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Flow 'volume_create_manager' (150d08e0-53be-4a69-bc63-6235e7b144cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5db48644-0357-4d6a-a804-baefc86974b3 tempest-TestImageHashVerification-2137206901 None] Created volume successfully. Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Flow 'volume_create_manager' (e8c313c1-680d-4fa6-a9b6-27feb9977de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9db49c-778d-457e-bb60-75025e96c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9db49c-778d-457e-bb60-75025e96c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-581532464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deff2431-bfb2-417c-a688-9143ecd5d768,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd417a589bf54f448ee3f4a9b6d3b991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:04Z,use_quota=True,user_id='c0fc638610264fce8cf4ab6df8552ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578e107e-acd4-4494-b050-3ec2e177e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578e107e-acd4-4494-b050-3ec2e177e408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ebbf5d-4bbb-459d-a602-4a5b7f832218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ebbf5d-4bbb-459d-a602-4a5b7f832218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deff2431-bfb2-417c-a688-9143ecd5d768', 'volume_name': 'volume-deff2431-bfb2-417c-a688-9143ecd5d768', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2def81a-5a57-4262-9ee0-f77ffa5c1b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2def81a-5a57-4262-9ee0-f77ffa5c1b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ce634b-3cdd-4b5a-957c-85e6859abccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Volume deff2431-bfb2-417c-a688-9143ecd5d768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deff2431-bfb2-417c-a688-9143ecd5d768', 'volume_size': 1} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-581532464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deff2431-bfb2-417c-a688-9143ecd5d768,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd417a589bf54f448ee3f4a9b6d3b991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:04Z,use_quota=True,user_id='c0fc638610264fce8cf4ab6df8552ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Creating volume deff2431-bfb2-417c-a688-9143ecd5d768 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:03 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:23:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:03 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 1073741824 Sep 28 12:23:03 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:04 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 1073741824" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:04 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 Sep 28 12:23:04 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:04 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768" returned: 0 in 0.298s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ce634b-3cdd-4b5a-957c-85e6859abccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deff2431-bfb2-417c-a688-9143ecd5d768', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa190cef-4cfd-48f1-8639-8438bc100331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Volume volume-deff2431-bfb2-417c-a688-9143ecd5d768 (deff2431-bfb2-417c-a688-9143ecd5d768): created successfully Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa190cef-4cfd-48f1-8639-8438bc100331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Flow 'volume_create_manager' (e8c313c1-680d-4fa6-a9b6-27feb9977de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-55ad1384-ecf7-4bb1-9d37-7bd57d3a4520 tempest-VolumesListTestJSON-1741615476 None] Created volume successfully. Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f4d9bc-6e1f-4a87-8f3a-d4b7748c8100]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:04 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 Sep 28 12:23:04 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:05 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1" returned: 0 in 0.398s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[21eb2060-fb3e-49d6-ae53-f16017f700e3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:05 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 Sep 28 12:23:05 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:05 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1" returned: 0 in 0.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 /opt/stack/data/cinder/conversion/8f8e31ac-8422-4613-a60c-c1763311a3b1.temp_image.bbe99652-b2c0-46fb-81b8-78b35cfd3e9740q2x0eh.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:05 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 /opt/stack/data/cinder/conversion/8f8e31ac-8422-4613-a60c-c1763311a3b1.temp_image.bbe99652-b2c0-46fb-81b8-78b35cfd3e9740q2x0eh.img Sep 28 12:23:05 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Flow 'volume_create_manager' (42ecefc0-5fae-4c7b-bb75-f4fd0697788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efba92f-807d-4393-81a6-fc9a091a7ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efba92f-807d-4393-81a6-fc9a091a7ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-292832495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b7de12-6831-4de3-ad29-bbe0d1734b41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd417a589bf54f448ee3f4a9b6d3b991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:07Z,use_quota=True,user_id='c0fc638610264fce8cf4ab6df8552ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35563753-63d7-409a-b397-8674593c1855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35563753-63d7-409a-b397-8674593c1855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb03903-2eeb-44e9-bd58-83524b8ea709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb03903-2eeb-44e9-bd58-83524b8ea709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b7de12-6831-4de3-ad29-bbe0d1734b41', 'volume_name': 'volume-48b7de12-6831-4de3-ad29-bbe0d1734b41', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f4ad25-7a80-4d67-b283-a2f8ac8ae886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f4ad25-7a80-4d67-b283-a2f8ac8ae886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b43f10a-3683-448f-b64a-98929b4d815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Volume 48b7de12-6831-4de3-ad29-bbe0d1734b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b7de12-6831-4de3-ad29-bbe0d1734b41', 'volume_size': 1} Sep 28 12:23:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:12 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 /opt/stack/data/cinder/conversion/8f8e31ac-8422-4613-a60c-c1763311a3b1.temp_image.bbe99652-b2c0-46fb-81b8-78b35cfd3e9740q2x0eh.img" returned: 0 in 7.118s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ca0496-40e2-42a3-88c1-0ffcad783438]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:12 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 Sep 28 12:23:12 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:13 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1" returned: 0 in 0.534s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:13 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1, size 1024.00 MB, duration 7.12 sec, destination /opt/stack/data/cinder/conversion/8f8e31ac-8422-4613-a60c-c1763311a3b1.temp_image.bbe99652-b2c0-46fb-81b8-78b35cfd3e9740q2x0eh.img {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:23:13 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Converted 1024.00 MB image at 143.85 MB/s Sep 28 12:23:13 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] bbe99652-b2c0-46fb-81b8-78b35cfd3e97 was raw, no need to convert to raw {{(pid=87167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 12:23:23 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=76,cinder:SELECT=54,cinder:DELETE=10,cinder:INSERT=19 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:23:23 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=73,cinder:SELECT=64,cinder:INSERT=26,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.486s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Uploaded volume to glance image-id: bbe99652-b2c0-46fb-81b8-78b35cfd3e97. {{(pid=87167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.481s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-292832495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b7de12-6831-4de3-ad29-bbe0d1734b41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd417a589bf54f448ee3f4a9b6d3b991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:07Z,use_quota=True,user_id='c0fc638610264fce8cf4ab6df8552ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Creating volume 48b7de12-6831-4de3-ad29-bbe0d1734b41 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:36 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-238c71c3-3942-4c08-8c8b-59c524c8797f tempest-TestImageHashVerification-2137206901 None] Copy volume to image completed successfully. Sep 28 12:23:36 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 1073741824 Sep 28 12:23:36 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:36 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 1073741824" returned: 0 in 0.573s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:36 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 Sep 28 12:23:36 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:37 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41" returned: 0 in 0.263s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b43f10a-3683-448f-b64a-98929b4d815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b7de12-6831-4de3-ad29-bbe0d1734b41', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e89c500-d88c-405a-89f4-25b30d046b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:37 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Volume volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 (48b7de12-6831-4de3-ad29-bbe0d1734b41): created successfully Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e89c500-d88c-405a-89f4-25b30d046b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Flow 'volume_create_manager' (42ecefc0-5fae-4c7b-bb75-f4fd0697788f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7369e22a-fea5-4010-b57d-faacb6ebcf82 tempest-VolumesListTestJSON-1741615476 None] Created volume successfully. Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Acquiring lock "cinder-8f8e31ac-8422-4613-a60c-c1763311a3b1-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Lock "cinder-8f8e31ac-8422-4613-a60c-c1763311a3b1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Acquiring lock "cinder-quobyte-8f8e31ac-8422-4613-a60c-c1763311a3b1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Lock "cinder-quobyte-8f8e31ac-8422-4613-a60c-c1763311a3b1" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[25be7652-b713-4842-898a-d0f82189ed5f]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:38 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 Sep 28 12:23:38 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:38 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1" returned: 0 in 0.437s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:38 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1 Sep 28 12:23:38 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Flow 'volume_create_manager' (b9e10fed-568f-4475-9ae3-b7333365d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa1d360-2203-4507-9c4c-16828f257127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:38 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8f8e31ac-8422-4613-a60c-c1763311a3b1" returned: 0 in 0.380s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa1d360-2203-4507-9c4c-16828f257127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-201892513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64085d33-a10b-4aac-9587-e15136338e4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd417a589bf54f448ee3f4a9b6d3b991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:39Z,use_quota=True,user_id='c0fc638610264fce8cf4ab6df8552ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d34ada-8892-4b0e-a181-250f3e50ead5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d34ada-8892-4b0e-a181-250f3e50ead5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f166ca53-18b7-4db4-ba95-c892d54e8226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f166ca53-18b7-4db4-ba95-c892d54e8226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64085d33-a10b-4aac-9587-e15136338e4f', 'volume_name': 'volume-64085d33-a10b-4aac-9587-e15136338e4f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf47246-aa2a-4e80-a4d4-104b1bd80745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf47246-aa2a-4e80-a4d4-104b1bd80745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45664f67-84ca-49a8-ac44-6a08f0fbd490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Volume 64085d33-a10b-4aac-9587-e15136338e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64085d33-a10b-4aac-9587-e15136338e4f', 'volume_size': 1} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-201892513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64085d33-a10b-4aac-9587-e15136338e4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd417a589bf54f448ee3f4a9b6d3b991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:39Z,use_quota=True,user_id='c0fc638610264fce8cf4ab6df8552ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Creating volume 64085d33-a10b-4aac-9587-e15136338e4f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:38 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Lock "cinder-quobyte-8f8e31ac-8422-4613-a60c-c1763311a3b1" released by "delete_volume" :: held 0.979s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:38 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f 1073741824 Sep 28 12:23:38 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:38 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Created reservations ['d86c2b01-e695-4554-836d-974171010f76', '4292d0f9-0923-4c67-b485-22f82478965b', 'bfb7376c-7f13-46f4-8dfa-1f78502df53e', 'd0b3a5f8-e61f-4f71-8184-fe845b2f6eb3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:39 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:23:39 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:39 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.309s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:23:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Deleted volume successfully. Sep 28 12:23:39 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ea37a20f-6750-4a9f-92b7-074cb8d569fa tempest-TestImageHashVerification-2137206901 None] Lock "cinder-8f8e31ac-8422-4613-a60c-c1763311a3b1-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f 1073741824" returned: 0 in 0.557s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:39 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f Sep 28 12:23:39 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:39 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f" returned: 0 in 0.269s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45664f67-84ca-49a8-ac44-6a08f0fbd490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64085d33-a10b-4aac-9587-e15136338e4f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1185b875-ea5b-44e4-a19c-11dc80743c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:39 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Volume volume-64085d33-a10b-4aac-9587-e15136338e4f (64085d33-a10b-4aac-9587-e15136338e4f): created successfully Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1185b875-ea5b-44e4-a19c-11dc80743c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Flow 'volume_create_manager' (b9e10fed-568f-4475-9ae3-b7333365d10c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f8056f33-b305-4f92-95db-009ba6f4b1b9 tempest-VolumesListTestJSON-1741615476 None] Created volume successfully. Sep 28 12:23:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "cinder-64085d33-a10b-4aac-9587-e15136338e4f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-64085d33-a10b-4aac-9587-e15136338e4f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "cinder-quobyte-64085d33-a10b-4aac-9587-e15136338e4f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-quobyte-64085d33-a10b-4aac-9587-e15136338e4f" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b45bf1-a9c4-489e-8c6b-a87fe8196f95]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:43 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f Sep 28 12:23:43 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:44 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f" returned: 0 in 0.486s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:44 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f Sep 28 12:23:44 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:44 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-64085d33-a10b-4aac-9587-e15136338e4f" returned: 0 in 0.299s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-quobyte-64085d33-a10b-4aac-9587-e15136338e4f" released by "delete_volume" :: held 0.843s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Created reservations ['acf25387-d5dc-421b-9e0a-80f0eeaa0ea5', 'a08c3861-1929-4173-a75d-548526f48390', '726a459f-1c86-48a3-8033-fedf5eaba713', 'acfe80a3-6fb9-4286-848b-6452e5fbf776'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:44 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:23:44 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "cinder-48b7de12-6831-4de3-ad29-bbe0d1734b41-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-48b7de12-6831-4de3-ad29-bbe0d1734b41-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "cinder-quobyte-48b7de12-6831-4de3-ad29-bbe0d1734b41" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:44 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-quobyte-48b7de12-6831-4de3-ad29-bbe0d1734b41" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.458s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:23:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Deleted volume successfully. Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e3c618-2be2-462c-974a-588f8f0e54cd]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f1eb3559-84f4-45f3-821f-f9444f1e95fe tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-64085d33-a10b-4aac-9587-e15136338e4f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:45 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 Sep 28 12:23:45 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:45 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41" returned: 0 in 0.496s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:45 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41 Sep 28 12:23:45 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:45 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-48b7de12-6831-4de3-ad29-bbe0d1734b41" returned: 0 in 0.326s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-quobyte-48b7de12-6831-4de3-ad29-bbe0d1734b41" released by "delete_volume" :: held 0.950s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Created reservations ['9c3b154a-10e8-4e5b-bae4-f8cc3147dd7b', '7622e4ad-a079-491a-90d0-75e045bc2081', '06e72714-707a-4cd7-b78b-53e99a9dfb31', '02c504b0-6c36-4574-ac9d-c30b623171c1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:46 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:23:46 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:46 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.488s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:23:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Deleted volume successfully. Sep 28 12:23:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0fd68b9c-fcf6-4aed-9720-4eab06c764ac tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-48b7de12-6831-4de3-ad29-bbe0d1734b41-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "cinder-deff2431-bfb2-417c-a688-9143ecd5d768-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-deff2431-bfb2-417c-a688-9143ecd5d768-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "cinder-quobyte-deff2431-bfb2-417c-a688-9143ecd5d768" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:47 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-quobyte-deff2431-bfb2-417c-a688-9143ecd5d768" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a326b-9538-4c2d-aa7d-59fd8687b308]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:47 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 Sep 28 12:23:47 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:47 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768" returned: 0 in 0.523s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:47 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768 Sep 28 12:23:47 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:48 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-deff2431-bfb2-417c-a688-9143ecd5d768" returned: 0 in 0.370s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-quobyte-deff2431-bfb2-417c-a688-9143ecd5d768" released by "delete_volume" :: held 0.974s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Created reservations ['af5be7d7-c85f-41f3-8084-c2b271af3a08', '46a2e5a7-56aa-4126-a6bf-c3f138ec3afa', '37e1b4b4-4ce2-4bde-b756-0b1aba35230a', 'd386b37b-5e82-46a7-af44-17e97fc43f13'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:48 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:23:48 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:49 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.486s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:23:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Deleted volume successfully. Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6140c4c8-86e2-431c-8e85-45a3c3d2cf0b tempest-VolumesListTestJSON-1741615476 None] Lock "cinder-deff2431-bfb2-417c-a688-9143ecd5d768-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:49 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:23:49 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:50 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.521s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:50 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:23:50 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:23:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:23:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (50ee6391-80a6-4308-9c17-a2f1284b4393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2397e2-1395-4251-a1ae-bd319d7d68c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2397e2-1395-4251-a1ae-bd319d7d68c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-545822855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9580d164-ec12-4487-9d57-d7f21ee46259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:55Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7705d1-30d9-4982-b583-392dfe468b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7705d1-30d9-4982-b583-392dfe468b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff47d4ce-5b46-4f17-8f2f-d1b6756ccadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff47d4ce-5b46-4f17-8f2f-d1b6756ccadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9580d164-ec12-4487-9d57-d7f21ee46259', 'volume_name': 'volume-9580d164-ec12-4487-9d57-d7f21ee46259', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27a84af-6fba-4435-9317-c9100e8b8336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27a84af-6fba-4435-9317-c9100e8b8336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5109d9-9ffa-4b53-97c7-2864bab38f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Volume 9580d164-ec12-4487-9d57-d7f21ee46259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9580d164-ec12-4487-9d57-d7f21ee46259', 'volume_size': 1} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-545822855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9580d164-ec12-4487-9d57-d7f21ee46259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:55Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Creating volume 9580d164-ec12-4487-9d57-d7f21ee46259 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:55 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:23:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:55 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 1073741824 Sep 28 12:23:55 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:56 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 1073741824" returned: 0 in 0.856s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:56 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 Sep 28 12:23:56 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:56 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259" returned: 0 in 0.395s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5109d9-9ffa-4b53-97c7-2864bab38f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9580d164-ec12-4487-9d57-d7f21ee46259', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f3abc1-df70-4181-b797-ff8bf793ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Volume volume-9580d164-ec12-4487-9d57-d7f21ee46259 (9580d164-ec12-4487-9d57-d7f21ee46259): created successfully Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f3abc1-df70-4181-b797-ff8bf793ef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (50ee6391-80a6-4308-9c17-a2f1284b4393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c82c74f9-ef0c-427e-9592-072fae162dd0 tempest-VolumesActionsTest-1571147532 None] Created volume successfully. Sep 28 12:23:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4683843e-e797-4151-ba3d-0d3a9dd647fa tempest-VolumesActionsTest-1571147532 None] Acquiring lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259" by "attach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4683843e-e797-4151-ba3d-0d3a9dd647fa tempest-VolumesActionsTest-1571147532 None] Lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259" acquired by "attach_volume" :: waited 0.064s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4683843e-e797-4151-ba3d-0d3a9dd647fa tempest-VolumesActionsTest-1571147532 None] Attaching volume 9580d164-ec12-4487-9d57-d7f21ee46259 to instance 4a4904fa-57d6-4b1e-b8d2-8a0a9411c429 at mountpoint /dev/vdb on host None. Sep 28 12:23:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4683843e-e797-4151-ba3d-0d3a9dd647fa tempest-VolumesActionsTest-1571147532 None] Attach volume completed successfully. Sep 28 12:23:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4683843e-e797-4151-ba3d-0d3a9dd647fa tempest-VolumesActionsTest-1571147532 None] Lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259" released by "attach_volume" :: held 0.266s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-22e62ac3-af06-4536-a2c3-189f7e0a722f tempest-VolumesActionsTest-1399458088 None] Terminate volume connection completed successfully. Sep 28 12:23:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-22e62ac3-af06-4536-a2c3-189f7e0a722f tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-detach_volume" by "detach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-22e62ac3-af06-4536-a2c3-189f7e0a722f tempest-VolumesActionsTest-1399458088 None] Lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-22e62ac3-af06-4536-a2c3-189f7e0a722f tempest-VolumesActionsTest-1399458088 None] Detaching volume 9580d164-ec12-4487-9d57-d7f21ee46259 from instance 4a4904fa-57d6-4b1e-b8d2-8a0a9411c429. Sep 28 12:23:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-22e62ac3-af06-4536-a2c3-189f7e0a722f tempest-VolumesActionsTest-1399458088 None] Detach volume completed successfully. Sep 28 12:23:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-22e62ac3-af06-4536-a2c3-189f7e0a722f tempest-VolumesActionsTest-1399458088 None] Lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e8ebb81-0f19-47d5-bd12-a2e69470b120 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-detach_volume" by "detach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e8ebb81-0f19-47d5-bd12-a2e69470b120 tempest-VolumesActionsTest-1571147532 None] Lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5e8ebb81-0f19-47d5-bd12-a2e69470b120 tempest-VolumesActionsTest-1571147532 None] Volume detach called, but volume not attached. Sep 28 12:23:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5e8ebb81-0f19-47d5-bd12-a2e69470b120 tempest-VolumesActionsTest-1571147532 None] Lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "cinder-quobyte-9580d164-ec12-4487-9d57-d7f21ee46259" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Lock "cinder-quobyte-9580d164-ec12-4487-9d57-d7f21ee46259" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f0acda-61bf-4bce-a12d-124e5bc610b2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:00 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 Sep 28 12:24:00 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:00 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259" returned: 0 in 0.534s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:00 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259 Sep 28 12:24:00 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:01 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9580d164-ec12-4487-9d57-d7f21ee46259" returned: 0 in 0.348s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Lock "cinder-quobyte-9580d164-ec12-4487-9d57-d7f21ee46259" released by "delete_volume" :: held 1.003s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Created reservations ['ad9c90cc-a4d9-4c32-9cc9-1d2ac81959b9', '2922aed1-3698-4b76-b4a4-ef8390eb0f62', 'c5fc20e2-c5fb-454c-96d8-f9dc8e98bc16', 'e1f6b8fc-8dde-4152-a3a4-4a92f66bcc1f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:01 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:01 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:01 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (bc07ef5f-bbfb-4844-8990-91e37119fb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4a3064-35b7-4452-bcd5-bd2e63901ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4a3064-35b7-4452-bcd5-bd2e63901ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-157874064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:02Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277478e4-e37e-4d9a-8e58-7c6bcf2fb33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277478e4-e37e-4d9a-8e58-7c6bcf2fb33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d7ebd1-b584-4378-8a85-6a956a54982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d7ebd1-b584-4378-8a85-6a956a54982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd', 'volume_name': 'volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcab6fd-712a-4343-a436-a10338450228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcab6fd-712a-4343-a436-a10338450228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1596c4c3-c0f3-4df6-a8a9-70c432c4149a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Volume 37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd', 'volume_size': 1} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-157874064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:02Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Creating volume 37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:02 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:02 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd 1073741824 Sep 28 12:24:02 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:02 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.676s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Deleted volume successfully. Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-35e56ad4-72bb-4894-b052-529634c4b3d5 tempest-VolumesActionsTest-1571147532 None] Lock "cinder-9580d164-ec12-4487-9d57-d7f21ee46259-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (bd1de691-2fdf-45da-9aa1-2464033b0b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb156e95-cb20-4209-8e99-bb308201dc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb156e95-cb20-4209-8e99-bb308201dc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1190861875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcecf64c-2f77-45a6-8f21-eef14f2e8245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:03Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fceeda-61d2-485a-9a51-98481f0e36b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88fceeda-61d2-485a-9a51-98481f0e36b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04f1159-928c-4656-b9ab-f4af2b933892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04f1159-928c-4656-b9ab-f4af2b933892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcecf64c-2f77-45a6-8f21-eef14f2e8245', 'volume_name': 'volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8a4300-4d50-4c68-af94-c6228b2f1bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8a4300-4d50-4c68-af94-c6228b2f1bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb0a405-8d62-4f36-8e90-0172d49f40b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Volume dcecf64c-2f77-45a6-8f21-eef14f2e8245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245', 'volume_size': 1} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:03 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd 1073741824" returned: 0 in 1.033s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:03 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd Sep 28 12:24:03 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:03 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (e96323db-b9a3-4353-94f7-fae6840b4e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccaf7e1-6b9d-46cc-a913-fc320dad4221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd" returned: 0 in 0.652s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1190861875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcecf64c-2f77-45a6-8f21-eef14f2e8245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:03Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Creating volume dcecf64c-2f77-45a6-8f21-eef14f2e8245 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccaf7e1-6b9d-46cc-a913-fc320dad4221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-396181423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a610c4b-217c-4915-97ba-6f0776284caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:04Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 1073741824 Sep 28 12:24:04 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e22370-2563-4bbb-bcea-098db9478dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e22370-2563-4bbb-bcea-098db9478dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ab285f-412d-4f80-974f-837cba535296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ab285f-412d-4f80-974f-837cba535296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a610c4b-217c-4915-97ba-6f0776284caf', 'volume_name': 'volume-6a610c4b-217c-4915-97ba-6f0776284caf', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e8f899-2057-4809-a540-1843a2c5bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e8f899-2057-4809-a540-1843a2c5bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13265531-1b84-4e15-9c6e-1ecda172a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Volume 6a610c4b-217c-4915-97ba-6f0776284caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a610c4b-217c-4915-97ba-6f0776284caf', 'volume_size': 1} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1596c4c3-c0f3-4df6-a8a9-70c432c4149a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bcbda2-be23-4247-af21-457c890fcb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Volume volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd (37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd): created successfully Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bcbda2-be23-4247-af21-457c890fcb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (bc07ef5f-bbfb-4844-8990-91e37119fb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fd92c1e2-6de2-4f09-979b-97db5cec833a tempest-CreateVolumesFromImageTest-117747149 None] Created volume successfully. Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (059aafb2-8351-4e67-adf6-3e4044102920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0999d58-cd26-4799-8186-448d1965ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0999d58-cd26-4799-8186-448d1965ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-273561609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c6a825-3915-452c-b94c-fd92141034b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:04Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcec94a7-1393-489c-8da5-12fa432dec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcec94a7-1393-489c-8da5-12fa432dec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fbb906-b0e6-42a3-adec-a61efa2ad3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fbb906-b0e6-42a3-adec-a61efa2ad3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c6a825-3915-452c-b94c-fd92141034b5', 'volume_name': 'volume-51c6a825-3915-452c-b94c-fd92141034b5', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2fb8ec-4719-455a-8898-b5c58fe5ed20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2fb8ec-4719-455a-8898-b5c58fe5ed20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0887a1-367a-4b79-961a-222612a0901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Volume 51c6a825-3915-452c-b94c-fd92141034b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c6a825-3915-452c-b94c-fd92141034b5', 'volume_size': 1} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:04 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 1073741824" returned: 0 in 0.681s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:04 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 Sep 28 12:24:04 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (e0b2f298-c60a-402b-aa01-46495b1f209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e91e75a-5bcc-401c-9f24-2cf9a5f3f3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e91e75a-5bcc-401c-9f24-2cf9a5f3f3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2102731592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18c1776-ea32-4c44-858f-f234b66588f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:05Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1817b53e-ed0f-428b-abe8-b2814b02d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1817b53e-ed0f-428b-abe8-b2814b02d10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a045acf5-1cf2-447e-aa86-53da3beca104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a045acf5-1cf2-447e-aa86-53da3beca104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a18c1776-ea32-4c44-858f-f234b66588f2', 'volume_name': 'volume-a18c1776-ea32-4c44-858f-f234b66588f2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed7ab4d-2ce3-406c-a0dd-0fac9943898e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed7ab4d-2ce3-406c-a0dd-0fac9943898e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ad3aaa-a62f-4696-b062-21b0499e3a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Volume a18c1776-ea32-4c44-858f-f234b66588f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a18c1776-ea32-4c44-858f-f234b66588f2', 'volume_size': 1} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:05 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245" returned: 0 in 0.450s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.096s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-396181423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a610c4b-217c-4915-97ba-6f0776284caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:04Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Creating volume 6a610c4b-217c-4915-97ba-6f0776284caf {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:05 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb0a405-8d62-4f36-8e90-0172d49f40b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a842a3-fd20-4191-a254-b1286a5e73fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:05 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf 1073741824 Sep 28 12:24:05 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Volume volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 (dcecf64c-2f77-45a6-8f21-eef14f2e8245): created successfully Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a842a3-fd20-4191-a254-b1286a5e73fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (bd1de691-2fdf-45da-9aa1-2464033b0b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3b382cae-f675-46d1-9560-c154864e0f24 tempest-CreateVolumesFromImageTest-117747149 None] Created volume successfully. Sep 28 12:24:05 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf 1073741824" returned: 0 in 0.718s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:06 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf Sep 28 12:24:06 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:06 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf" returned: 0 in 0.394s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-273561609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c6a825-3915-452c-b94c-fd92141034b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:04Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Creating volume 51c6a825-3915-452c-b94c-fd92141034b5 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:06 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13265531-1b84-4e15-9c6e-1ecda172a43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a610c4b-217c-4915-97ba-6f0776284caf', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccc6cdf-e1a4-4629-94d8-218536a8ac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:06 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 1073741824 Sep 28 12:24:06 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Volume volume-6a610c4b-217c-4915-97ba-6f0776284caf (6a610c4b-217c-4915-97ba-6f0776284caf): created successfully Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccc6cdf-e1a4-4629-94d8-218536a8ac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (e96323db-b9a3-4353-94f7-fae6840b4e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3ef2d6e0-0df6-45af-84ec-a5f0c7c99c6b tempest-CreateVolumesFromImageTest-117747149 None] Created volume successfully. Sep 28 12:24:07 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 1073741824" returned: 0 in 0.615s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:07 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 Sep 28 12:24:07 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:07 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5" returned: 0 in 0.406s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.434s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2102731592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18c1776-ea32-4c44-858f-f234b66588f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d788154c374c43a798af88016780a54c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:05Z,use_quota=True,user_id='de189817dd2d489d984f0e63c65a4265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Creating volume a18c1776-ea32-4c44-858f-f234b66588f2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:07 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 1073741824 Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0887a1-367a-4b79-961a-222612a0901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c6a825-3915-452c-b94c-fd92141034b5', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:07 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32648858-5723-44eb-9248-f8a578eb2e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Volume volume-51c6a825-3915-452c-b94c-fd92141034b5 (51c6a825-3915-452c-b94c-fd92141034b5): created successfully Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32648858-5723-44eb-9248-f8a578eb2e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (059aafb2-8351-4e67-adf6-3e4044102920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dbaa9e8d-98a3-4b1e-9f7d-1e5930fdf1ee tempest-CreateVolumesFromImageTest-117747149 None] Created volume successfully. Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (e0485a05-394b-4f86-bb75-84b3c6103f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d0113a-8203-4231-b15a-a0ba1c2bdc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d0113a-8203-4231-b15a-a0ba1c2bdc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-224154544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22493c9-a7a2-44f2-af0c-5573268a9d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:08Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92aebb65-9290-4e95-840f-5806361899e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92aebb65-9290-4e95-840f-5806361899e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f199709b-e692-4ecd-a950-0881e344b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f199709b-e692-4ecd-a950-0881e344b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e22493c9-a7a2-44f2-af0c-5573268a9d29', 'volume_name': 'volume-e22493c9-a7a2-44f2-af0c-5573268a9d29', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad432812-e0d1-4f80-bddf-cd065a4b0907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad432812-e0d1-4f80-bddf-cd065a4b0907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1f3f94-6680-47cd-bf58-34453f3d4ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Volume e22493c9-a7a2-44f2-af0c-5573268a9d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e22493c9-a7a2-44f2-af0c-5573268a9d29', 'volume_size': 1} Sep 28 12:24:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:08 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 1073741824" returned: 0 in 0.513s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:08 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 Sep 28 12:24:08 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:08 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2" returned: 0 in 0.254s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-224154544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22493c9-a7a2-44f2-af0c-5573268a9d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:08Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Creating volume e22493c9-a7a2-44f2-af0c-5573268a9d29 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:08 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ad3aaa-a62f-4696-b062-21b0499e3a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a18c1776-ea32-4c44-858f-f234b66588f2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9df2fde-9231-4ef5-8daa-a03dc97af664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Volume volume-a18c1776-ea32-4c44-858f-f234b66588f2 (a18c1776-ea32-4c44-858f-f234b66588f2): created successfully Sep 28 12:24:08 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 1073741824 Sep 28 12:24:08 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9df2fde-9231-4ef5-8daa-a03dc97af664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Flow 'volume_create_manager' (e0b2f298-c60a-402b-aa01-46495b1f209c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d704aa1c-b19f-49af-aa9f-e4bbfd083bf6 tempest-CreateVolumesFromImageTest-117747149 None] Created volume successfully. Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-a18c1776-ea32-4c44-858f-f234b66588f2-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-a18c1776-ea32-4c44-858f-f234b66588f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-quobyte-a18c1776-ea32-4c44-858f-f234b66588f2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-a18c1776-ea32-4c44-858f-f234b66588f2" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5253fdf-8fb8-4c69-9827-0c2d69f8728c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:08 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 Sep 28 12:24:08 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:09 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 1073741824" returned: 0 in 0.697s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:09 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 Sep 28 12:24:09 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:09 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2" returned: 0 in 0.503s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:09 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2 Sep 28 12:24:09 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:09 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1f3f94-6680-47cd-bf58-34453f3d4ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e22493c9-a7a2-44f2-af0c-5573268a9d29', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1a973a-c090-4726-b09f-07a38ad163ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Volume volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 (e22493c9-a7a2-44f2-af0c-5573268a9d29): created successfully Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1a973a-c090-4726-b09f-07a38ad163ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (e0485a05-394b-4f86-bb75-84b3c6103f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ea09e686-0d2a-4f36-82e4-cf9d38a80e8b tempest-VolumesActionsTest-1571147532 None] Created volume successfully. Sep 28 12:24:09 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a18c1776-ea32-4c44-858f-f234b66588f2" returned: 0 in 0.357s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-a18c1776-ea32-4c44-858f-f234b66588f2" released by "delete_volume" :: held 0.924s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Created reservations ['d2d80c23-08d9-4f79-955f-095b08de7661', '4f47fd06-0e9e-4b96-9f48-b68ed3271d7a', '3cf7ea14-2b7d-49c6-96e0-5619440c72ae', '9c5d0032-a66c-4974-b0f4-36db4ad80054'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:09 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:09 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-51c6a825-3915-452c-b94c-fd92141034b5-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-51c6a825-3915-452c-b94c-fd92141034b5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-quobyte-51c6a825-3915-452c-b94c-fd92141034b5" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-51c6a825-3915-452c-b94c-fd92141034b5" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482047f-f307-40a4-85e9-373695c31a29]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-e22493c9-a7a2-44f2-af0c-5573268a9d29-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:10 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.400s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Deleted volume successfully. Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-e22493c9-a7a2-44f2-af0c-5573268a9d29-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e4b66515-09b8-4e4f-b5cb-c117bf5cba25 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-a18c1776-ea32-4c44-858f-f234b66588f2-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-quobyte-e22493c9-a7a2-44f2-af0c-5573268a9d29" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-quobyte-e22493c9-a7a2-44f2-af0c-5573268a9d29" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d32a5b7-22db-4567-8599-8a445254437d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:10 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 Sep 28 12:24:10 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:10 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 Sep 28 12:24:10 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:10 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5" returned: 0 in 0.626s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:10 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5 Sep 28 12:24:10 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:10 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29" returned: 0 in 0.490s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:11 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29 Sep 28 12:24:11 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:11 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-51c6a825-3915-452c-b94c-fd92141034b5" returned: 0 in 0.296s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-51c6a825-3915-452c-b94c-fd92141034b5" released by "delete_volume" :: held 1.106s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Created reservations ['35424efa-8786-4fa0-942e-e3f4a569f304', '4d27e94f-e013-4457-aa6c-5c8338367f8d', '34eefe1f-b72b-41fc-98cc-25cebaa125d5', '9ea14248-745d-48af-b976-8c45a6cc412e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:11 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e22493c9-a7a2-44f2-af0c-5573268a9d29" returned: 0 in 0.312s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-quobyte-e22493c9-a7a2-44f2-af0c-5573268a9d29" released by "delete_volume" :: held 0.862s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:11 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:11 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Created reservations ['54075762-2d94-473e-b57c-fa24d2663c30', '9c74b7f0-4f6c-41e0-bff9-de678fcd9abe', '9cb2781d-4ec1-4a32-8fc3-57d8ed3b9e2a', 'f8dfe7ab-bf02-45f1-b666-8bfb94f62c8e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:11 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:11 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:11 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.325s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Deleted volume successfully. Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-08f8a491-dcc4-4dee-85fb-f4159972b95c tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-51c6a825-3915-452c-b94c-fd92141034b5-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:11 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.279s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Deleted volume successfully. Sep 28 12:24:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-03388c39-0b65-4d85-8f49-785fa23c0a86 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-e22493c9-a7a2-44f2-af0c-5573268a9d29-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (84cb7f33-1a9f-4929-82f5-9325727c6a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3773efff-0927-411d-8c9d-901980446982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-6a610c4b-217c-4915-97ba-6f0776284caf-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3773efff-0927-411d-8c9d-901980446982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1614870599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbbe06b-536d-489c-ab09-6aa7828b9fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f562eba36648f1b60a862e9383f882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:12Z,use_quota=True,user_id='f9b26f052cb94f7f9bfc1eb35f2fb644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897053d4-99cc-4212-b038-4235855e6e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897053d4-99cc-4212-b038-4235855e6e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9a74dd-86ed-4718-aee3-e7f4d76d717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9a74dd-86ed-4718-aee3-e7f4d76d717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccbbe06b-536d-489c-ab09-6aa7828b9fcd', 'volume_name': 'volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed9d02a-8c19-4c09-9e17-789eef6c2aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed9d02a-8c19-4c09-9e17-789eef6c2aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bd5e18-2172-4a91-9d11-b7c7e534d06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Volume ccbbe06b-536d-489c-ab09-6aa7828b9fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd', 'volume_size': 1} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1614870599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbbe06b-536d-489c-ab09-6aa7828b9fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f562eba36648f1b60a862e9383f882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:12Z,use_quota=True,user_id='f9b26f052cb94f7f9bfc1eb35f2fb644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Creating volume ccbbe06b-536d-489c-ab09-6aa7828b9fcd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:12 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-6a610c4b-217c-4915-97ba-6f0776284caf-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:12 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd 1073741824 Sep 28 12:24:12 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-quobyte-6a610c4b-217c-4915-97ba-6f0776284caf" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-6a610c4b-217c-4915-97ba-6f0776284caf" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[18628856-e1e8-4337-9a01-f29636b7dcdb]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:12 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf Sep 28 12:24:12 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:12 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd 1073741824" returned: 0 in 0.553s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:13 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf" returned: 0 in 0.498s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:13 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd Sep 28 12:24:13 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:13 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf Sep 28 12:24:13 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (bb468ce8-d143-470f-a0e5-d786e9b9810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab5d47f-2a4e-4fcf-851e-63d4f446da9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:13 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab5d47f-2a4e-4fcf-851e-63d4f446da9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1405213329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e0b679-330b-4563-98ab-9591616becbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:13Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ce391d-e726-477c-a878-0a7d1b826704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ce391d-e726-477c-a878-0a7d1b826704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c03baa3-89e8-4c6b-8774-b55966105c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c03baa3-89e8-4c6b-8774-b55966105c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e0b679-330b-4563-98ab-9591616becbd', 'volume_name': 'volume-30e0b679-330b-4563-98ab-9591616becbd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87dbc85-7ce4-40e9-9033-7df475d51549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87dbc85-7ce4-40e9-9033-7df475d51549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:13 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22abcd88-62c2-4d38-832e-8760075311d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Volume 30e0b679-330b-4563-98ab-9591616becbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e0b679-330b-4563-98ab-9591616becbd', 'volume_size': 1} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6a610c4b-217c-4915-97ba-6f0776284caf" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" returned: 0 in 0.340s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1405213329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e0b679-330b-4563-98ab-9591616becbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:13Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Creating volume 30e0b679-330b-4563-98ab-9591616becbd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:13 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bd5e18-2172-4a91-9d11-b7c7e534d06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:13 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd 1073741824 Sep 28 12:24:13 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b30302-b1df-45e8-b11a-a50a27c01665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-6a610c4b-217c-4915-97ba-6f0776284caf" released by "delete_volume" :: held 0.930s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Volume volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd (ccbbe06b-536d-489c-ab09-6aa7828b9fcd): created successfully Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b30302-b1df-45e8-b11a-a50a27c01665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (84cb7f33-1a9f-4929-82f5-9325727c6a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4329acec-bdf5-447b-b67f-23a9652477fc tempest-VolumesSnapshotTestJSON-381674265 None] Created volume successfully. Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Created reservations ['6708c8cf-5ded-4420-8de9-e5f53e362c43', '03425d97-41e9-4f5b-af40-79d6e8aa3f51', '8b9432fd-c0d7-45a0-8563-f99db99ac7fb', '3da638c9-3856-47d3-995d-de81db25ce3c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:13 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:13 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:13 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd 1073741824" returned: 0 in 0.470s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:13 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.309s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Deleted volume successfully. Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25770807-3c6a-4ea1-ae82-638d70749331 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-6a610c4b-217c-4915-97ba-6f0776284caf-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:13 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd Sep 28 12:24:13 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:14 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd" returned: 0 in 0.266s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22abcd88-62c2-4d38-832e-8760075311d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e0b679-330b-4563-98ab-9591616becbd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2e8bf7-9b4d-4453-b619-641be49fae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Volume volume-30e0b679-330b-4563-98ab-9591616becbd (30e0b679-330b-4563-98ab-9591616becbd): created successfully Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2e8bf7-9b4d-4453-b619-641be49fae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (bb468ce8-d143-470f-a0e5-d786e9b9810f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7936822b-7cd4-47a5-92f9-616c30e21c8e tempest-VolumesActionsTest-1571147532 None] Created volume successfully. Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-dcecf64c-2f77-45a6-8f21-eef14f2e8245-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-dcecf64c-2f77-45a6-8f21-eef14f2e8245-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-quobyte-dcecf64c-2f77-45a6-8f21-eef14f2e8245" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-dcecf64c-2f77-45a6-8f21-eef14f2e8245" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae64836-6feb-47cb-b46c-4e0ecf6f48c1]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Creating offline snapshot 77f4096b-443f-41f2-9d2c-09cee3e8981c of volume ccbbe06b-536d-489c-ab09-6aa7828b9fcd {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03a6a12-95c6-4264-92ff-157cb7bdacf8]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:14 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 Sep 28 12:24:14 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:14 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd Sep 28 12:24:14 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:15 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245" returned: 0 in 0.395s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:15 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245 Sep 28 12:24:15 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:15 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" returned: 0 in 0.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:15 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c 1G Sep 28 12:24:15 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:15 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcecf64c-2f77-45a6-8f21-eef14f2e8245" returned: 0 in 0.295s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-dcecf64c-2f77-45a6-8f21-eef14f2e8245" released by "delete_volume" :: held 0.758s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-30e0b679-330b-4563-98ab-9591616becbd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-30e0b679-330b-4563-98ab-9591616becbd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Created reservations ['a45a8d91-4900-4a62-a4ff-e8e4f883143c', 'cb378a40-859f-4f7e-a9d7-f2ae3d66fb2e', '8a84d341-71f9-4ea3-9e79-c5a4b0985a0a', '939a4c2a-1984-41f6-a4b9-ba98ebc29a22'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-quobyte-30e0b679-330b-4563-98ab-9591616becbd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-quobyte-30e0b679-330b-4563-98ab-9591616becbd" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bcaf31-655f-413a-937d-a278226695a7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:15 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:15 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:15 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c 1G" returned: 0 in 0.558s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:15 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd Sep 28 12:24:15 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:15 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c Sep 28 12:24:15 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "cinder-quobyte-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fd6779-a827-486a-8493-1e868016a2fa]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:16 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.374s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Deleted volume successfully. Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-245322ce-2eeb-40e6-9bba-3115fd9d0ff7 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-dcecf64c-2f77-45a6-8f21-eef14f2e8245-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:16 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd Sep 28 12:24:16 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:16 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd" returned: 0 in 0.549s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:16 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c" returned: 0 in 0.403s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:16 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c is being set with open permissions: ugo+rw Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:16 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd Sep 28 12:24:16 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:16 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c Sep 28 12:24:16 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:16 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30e0b679-330b-4563-98ab-9591616becbd" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:16 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c" returned: 0 in 0.281s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd" returned: 0 in 0.467s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-quobyte-30e0b679-330b-4563-98ab-9591616becbd" released by "delete_volume" :: held 0.902s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:16 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd Sep 28 12:24:16 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:16 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.info Sep 28 12:24:16 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Created reservations ['27a7eec9-1d94-4cfe-b21c-896ed901baa6', 'e9eb8819-4a34-43cd-919d-2536507950d2', '4e4ee1c5-2ef9-41a6-bdb5-5d614e5a3a6a', '31203430-d197-429d-bb90-f48339ea0a9d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:16 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:16 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:16 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd" returned: 0 in 0.298s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-quobyte-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd" released by "delete_volume" :: held 0.844s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Created reservations ['e93dcccb-7ff4-43b6-9442-9fbb9fa5cc99', '0bdc9087-a86f-4e45-b857-27ed2cdb8938', 'aee63318-e328-4704-843f-16b3d1047b57', '1111efe4-1435-4952-be13-828f6a7bef95'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:16 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.info" returned: 0 in 0.362s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:16 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.info is being set with open permissions: ugo+rw Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:16 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.info Sep 28 12:24:16 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:16 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.325s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:17 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Deleted volume successfully. Sep 28 12:24:17 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:17 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-184d5bde-a215-4777-ba6a-9695808c71e9 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-30e0b679-330b-4563-98ab-9591616becbd-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:17 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.info" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:17 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.319s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:17 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Deleted volume successfully. Sep 28 12:24:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-45762956-08e5-491c-9d01-87a98544b4f0 tempest-VolumesSnapshotTestJSON-381674265 None] Create snapshot completed successfully Sep 28 12:24:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-cc0481e0-34e3-450f-802b-0ed813a29cd8 tempest-CreateVolumesFromImageTest-117747149 None] Lock "cinder-37c5f3e2-b1fa-4f0b-a3b1-58e760f0a6dd-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-77f4096b-443f-41f2-9d2c-09cee3e8981c-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-77f4096b-443f-41f2-9d2c-09cee3e8981c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-77f4096b-443f-41f2-9d2c-09cee3e8981c" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-77f4096b-443f-41f2-9d2c-09cee3e8981c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Deleting offline snapshot 77f4096b-443f-41f2-9d2c-09cee3e8981c of volume ccbbe06b-536d-489c-ab09-6aa7828b9fcd {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] snapshot_file for this snap is: volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[610026a5-12c6-4b19-8084-116408a599b4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:18 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c Sep 28 12:24:18 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (9ab3344c-89df-4695-bef4-8feac1f54007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04407960-68d7-4657-9635-bb3638309bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04407960-68d7-4657-9635-bb3638309bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766370404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5accd3e0-0a32-45b8-9d9b-a1d8f19f8245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:18Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a79453b-fc07-43e8-9d0c-9eacbfdade2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a79453b-fc07-43e8-9d0c-9eacbfdade2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c00f098-8c41-461d-b757-8452844bc014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c00f098-8c41-461d-b757-8452844bc014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5accd3e0-0a32-45b8-9d9b-a1d8f19f8245', 'volume_name': 'volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8aebe82-43c5-498f-b7a5-dbb14e1bcf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8aebe82-43c5-498f-b7a5-dbb14e1bcf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069e28d0-6d7e-49ff-a312-f08132c04d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Volume 5accd3e0-0a32-45b8-9d9b-a1d8f19f8245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245', 'volume_size': 1} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766370404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5accd3e0-0a32-45b8-9d9b-a1d8f19f8245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:18Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Creating volume 5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:18 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:18 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 1073741824 Sep 28 12:24:18 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:18 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c" returned: 0 in 0.472s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d19f5e6-ef4b-4c5d-a3f3-7dac7bdc1f23]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:19 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd Sep 28 12:24:19 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:19 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 1073741824" returned: 0 in 0.545s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:19 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 Sep 28 12:24:19 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:19 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" returned: 0 in 0.497s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:19 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c Sep 28 12:24:19 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:19 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245" returned: 0 in 0.293s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069e28d0-6d7e-49ff-a312-f08132c04d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8102cda-9bd5-4982-a9e9-4c52947f37a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:19 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Volume volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 (5accd3e0-0a32-45b8-9d9b-a1d8f19f8245): created successfully Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8102cda-9bd5-4982-a9e9-4c52947f37a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (9ab3344c-89df-4695-bef4-8feac1f54007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b005e168-bfc3-4400-9afe-8f23b93d6112 tempest-VolumesActionsTest-1571147532 None] Created volume successfully. Sep 28 12:24:19 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c" returned: 0 in 0.393s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:19 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c Sep 28 12:24:19 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:20 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd.77f4096b-443f-41f2-9d2c-09cee3e8981c" returned: 0 in 0.282s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-77f4096b-443f-41f2-9d2c-09cee3e8981c" released by "_delete_snapshot" :: held 1.808s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" released by "delete_snapshot" :: held 1.839s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Created reservations ['0bcc1593-04c0-432b-a3c9-945c7f890c0f', '0e60569d-1ff7-41b2-a2eb-98c9820b4885', '48fc9eb6-7d11-457b-8dca-c38f03263496', '1bd5468b-739b-4518-9a37-947abca05eac'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Delete snapshot completed successfully. Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-343a3615-1bae-43aa-8520-75e70c9d1d64 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-77f4096b-443f-41f2-9d2c-09cee3e8981c-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (fc2f825a-a4f1-41a0-be28-a60fa6fdc1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cfcd41-7089-4c46-8475-4d97692da785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cfcd41-7089-4c46-8475-4d97692da785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7009090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4717c846-09b5-4024-854d-92b6e7b96bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:21Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7a180e-0df5-41e0-9a0d-95dece073616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7a180e-0df5-41e0-9a0d-95dece073616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38838dba-cd84-4df0-b8ca-5f533f95ff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38838dba-cd84-4df0-b8ca-5f533f95ff1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4717c846-09b5-4024-854d-92b6e7b96bfa', 'volume_name': 'volume-4717c846-09b5-4024-854d-92b6e7b96bfa', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dcb8da-807a-49b4-86d8-65c2887d6690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dcb8da-807a-49b4-86d8-65c2887d6690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34076da-aa9a-4a38-86ef-26aa8a59786e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume 4717c846-09b5-4024-854d-92b6e7b96bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4717c846-09b5-4024-854d-92b6e7b96bfa', 'volume_size': 1} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-7009090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4717c846-09b5-4024-854d-92b6e7b96bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:21Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Creating volume 4717c846-09b5-4024-854d-92b6e7b96bfa {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:20 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:20 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa 1073741824 Sep 28 12:24:20 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-quobyte-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-quobyte-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[484c53a6-3cf3-4bc2-b12d-f0cacf18e37e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (737efd29-4719-4d13-8004-9e02124a68c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b3b5f1-9a16-45eb-abe9-01a06c283370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b3b5f1-9a16-45eb-abe9-01a06c283370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1581761905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060ac85f-1634-4321-a5fa-be4c8347b21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f562eba36648f1b60a862e9383f882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:21Z,use_quota=True,user_id='f9b26f052cb94f7f9bfc1eb35f2fb644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729d469e-029e-493c-8f29-ebad9be57034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729d469e-029e-493c-8f29-ebad9be57034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524fadfd-c099-4dc4-b019-d67099222b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524fadfd-c099-4dc4-b019-d67099222b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060ac85f-1634-4321-a5fa-be4c8347b21b', 'volume_name': 'volume-060ac85f-1634-4321-a5fa-be4c8347b21b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b90c44-31a0-43ad-bbb0-37643744b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b90c44-31a0-43ad-bbb0-37643744b67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad590d1d-b3b7-40ee-879a-719efe2676da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Volume 060ac85f-1634-4321-a5fa-be4c8347b21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060ac85f-1634-4321-a5fa-be4c8347b21b', 'volume_size': 1} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:21 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 Sep 28 12:24:21 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:21 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa 1073741824" returned: 0 in 0.665s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:21 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245" returned: 0 in 0.504s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:21 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa Sep 28 12:24:21 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:21 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245 Sep 28 12:24:21 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:21 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa" returned: 0 in 0.302s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1581761905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060ac85f-1634-4321-a5fa-be4c8347b21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f562eba36648f1b60a862e9383f882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:21Z,use_quota=True,user_id='f9b26f052cb94f7f9bfc1eb35f2fb644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Creating volume 060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:21 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34076da-aa9a-4a38-86ef-26aa8a59786e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4717c846-09b5-4024-854d-92b6e7b96bfa', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a543404a-30fa-47bf-8f44-dcbf72d86849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:21 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b 1073741824 Sep 28 12:24:21 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:21 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245" returned: 0 in 0.334s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume volume-4717c846-09b5-4024-854d-92b6e7b96bfa (4717c846-09b5-4024-854d-92b6e7b96bfa): created successfully Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a543404a-30fa-47bf-8f44-dcbf72d86849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (fc2f825a-a4f1-41a0-be28-a60fa6fdc1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-quobyte-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245" released by "delete_volume" :: held 0.935s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e9c78cf2-ab4c-411d-b49b-a1d36a34db27 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created volume successfully. Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Created reservations ['414ecf24-5b9b-4139-9f0c-b54854652232', '6509d912-0f65-4c50-8b1d-23f627a9284f', 'fcd129aa-4340-4ee0-aab6-91dc4f71a53d', '70f3c1f5-a2f2-4ada-ab6e-339005a3f7df'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:22 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:22 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:22 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b 1073741824" returned: 0 in 0.518s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:22 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:22 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.308s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:22 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Deleted volume successfully. Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a1cead1-f45d-4824-ab62-acf3e5adcb46 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-5accd3e0-0a32-45b8-9d9b-a1d8f19f8245-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:22 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b" returned: 0 in 0.281s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad590d1d-b3b7-40ee-879a-719efe2676da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060ac85f-1634-4321-a5fa-be4c8347b21b', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c533721e-16e0-4340-ae74-1f261fe3b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:22 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Volume volume-060ac85f-1634-4321-a5fa-be4c8347b21b (060ac85f-1634-4321-a5fa-be4c8347b21b): created successfully Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c533721e-16e0-4340-ae74-1f261fe3b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (737efd29-4719-4d13-8004-9e02124a68c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0eec73b9-285a-4dcd-ab6c-35eecf094af9 tempest-VolumesSnapshotTestJSON-381674265 None] Created volume successfully. Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (936035c1-ff3a-4b6f-a1d4-346e0fe0d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82423512-7d01-4c6e-88df-5ad05fbcafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82423512-7d01-4c6e-88df-5ad05fbcafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636056172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94858fd9-025a-4712-ba5d-5ed1d16f927c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:23Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ff8527-6b75-40c3-9ec6-c781be05c514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ff8527-6b75-40c3-9ec6-c781be05c514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b531f6-7543-41da-9ade-5f14bb84022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b531f6-7543-41da-9ade-5f14bb84022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94858fd9-025a-4712-ba5d-5ed1d16f927c', 'volume_name': 'volume-94858fd9-025a-4712-ba5d-5ed1d16f927c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffd2f08-0606-4c5b-be51-a26bc5e75459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffd2f08-0606-4c5b-be51-a26bc5e75459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13da5577-f80d-4144-8c0a-0818e33755a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume 94858fd9-025a-4712-ba5d-5ed1d16f927c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94858fd9-025a-4712-ba5d-5ed1d16f927c', 'volume_size': 1} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636056172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94858fd9-025a-4712-ba5d-5ed1d16f927c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:23Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Creating volume 94858fd9-025a-4712-ba5d-5ed1d16f927c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:23 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:23 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c 1073741824 Sep 28 12:24:23 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (2a85345f-edd6-4ccf-945a-2063b612a7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ce4e7a-eace-4ea4-86f3-8a55488a7fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ce4e7a-eace-4ea4-86f3-8a55488a7fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736270236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:24Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1062fa42-54e5-47dd-b013-932ba822cef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1062fa42-54e5-47dd-b013-932ba822cef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf86ba9-57fd-44e0-bdb3-9386f1c69d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf86ba9-57fd-44e0-bdb3-9386f1c69d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36', 'volume_name': 'volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e39c933-ff52-4ca1-b408-fe9c178b522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e39c933-ff52-4ca1-b408-fe9c178b522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8a949e-df3c-4020-b66d-b753499b29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume 11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36', 'volume_size': 1} Sep 28 12:24:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:24 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c 1073741824" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:24 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c Sep 28 12:24:24 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (a969b186-7f3d-4a70-8370-d51dc5a63ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107e1ceb-de67-41d6-ba86-46f2bc4b1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107e1ceb-de67-41d6-ba86-46f2bc4b1660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1451562467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3347cad-0311-4a52-af62-136726913932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:24Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21a4060-1676-45b3-957e-a5e01a87e2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21a4060-1676-45b3-957e-a5e01a87e2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa887c5-da07-4ba1-b292-f983228a7a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa887c5-da07-4ba1-b292-f983228a7a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3347cad-0311-4a52-af62-136726913932', 'volume_name': 'volume-a3347cad-0311-4a52-af62-136726913932', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32cedad-d884-4c1c-a99e-300397c6f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32cedad-d884-4c1c-a99e-300397c6f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac2f503-50ba-4246-ba22-305b29567ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Volume a3347cad-0311-4a52-af62-136726913932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3347cad-0311-4a52-af62-136726913932', 'volume_size': 1} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (71f72ce6-a009-4327-9c4f-fb9b657958b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa202f45-b930-49a0-a118-031d4c91e2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c" returned: 0 in 0.362s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.046s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13da5577-f80d-4144-8c0a-0818e33755a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94858fd9-025a-4712-ba5d-5ed1d16f927c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ee4bbe-f98a-48be-9ebb-bb2c990d3627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa202f45-b930-49a0-a118-031d4c91e2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-606061621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1245e219-8252-436f-bbf6-ffa3844c19af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:24Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219d2c0d-be5a-4f9c-b1a4-972add059a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219d2c0d-be5a-4f9c-b1a4-972add059a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a7a2b0-6641-4f65-a37a-9d0412eb4a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a7a2b0-6641-4f65-a37a-9d0412eb4a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1245e219-8252-436f-bbf6-ffa3844c19af', 'volume_name': 'volume-1245e219-8252-436f-bbf6-ffa3844c19af', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04057ef5-5eae-43fd-b7d8-ac3eb195f3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04057ef5-5eae-43fd-b7d8-ac3eb195f3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3829553-9e81-4e1c-bd42-abe04b67f132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume 1245e219-8252-436f-bbf6-ffa3844c19af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1245e219-8252-436f-bbf6-ffa3844c19af', 'volume_size': 1} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Creating offline snapshot bb179241-92af-4796-a4a6-5b210b2e5b25 of volume 060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:24:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume volume-94858fd9-025a-4712-ba5d-5ed1d16f927c (94858fd9-025a-4712-ba5d-5ed1d16f927c): created successfully Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ee4bbe-f98a-48be-9ebb-bb2c990d3627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (936035c1-ff3a-4b6f-a1d4-346e0fe0d547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[64609f28-e116-4412-ba55-4443b391f980]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d95adb7c-1f4a-4b16-93a6-dacf1fd61ce9 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created volume successfully. Sep 28 12:24:24 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b Sep 28 12:24:24 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (14f0ef06-3bbe-4078-80f1-3237f5561b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6300ca4-3107-4d81-80fd-50502f34921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6300ca4-3107-4d81-80fd-50502f34921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281336282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10efc3bc-3caf-4776-bb9c-71fdc3f4259a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:25Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93986e8b-c1a2-4227-a7b3-cd857da23f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93986e8b-c1a2-4227-a7b3-cd857da23f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d69e2a2-9b2a-47f6-afd3-f4c559bad111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d69e2a2-9b2a-47f6-afd3-f4c559bad111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10efc3bc-3caf-4776-bb9c-71fdc3f4259a', 'volume_name': 'volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425cecc5-7226-409a-a3ff-615eaf44d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425cecc5-7226-409a-a3ff-615eaf44d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d6b888-0346-4f70-bfe0-d3709ae1ac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:24 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume 10efc3bc-3caf-4776-bb9c-71fdc3f4259a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a', 'volume_size': 1} Sep 28 12:24:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:25 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b" returned: 0 in 0.457s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:25 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 1G Sep 28 12:24:25 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (b9ca9094-a28e-4098-a066-47f7fc33e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d243d784-453d-4dbe-b208-62479bdc3b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d243d784-453d-4dbe-b208-62479bdc3b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2140894159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189fde17-4fcf-41af-86d6-9723c4dba94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:25Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7722ba-d404-4ad4-822f-80838985f2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7722ba-d404-4ad4-822f-80838985f2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2b2043-df9a-4575-bb95-843469298d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2b2043-df9a-4575-bb95-843469298d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189fde17-4fcf-41af-86d6-9723c4dba94a', 'volume_name': 'volume-189fde17-4fcf-41af-86d6-9723c4dba94a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dfd771-37a4-446d-839d-27585aa403bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dfd771-37a4-446d-839d-27585aa403bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebff0c08-7ad8-4ce8-bc25-5c374189180a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume 189fde17-4fcf-41af-86d6-9723c4dba94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189fde17-4fcf-41af-86d6-9723c4dba94a', 'volume_size': 1} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:25 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 1G" returned: 0 in 0.421s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-060ac85f-1634-4321-a5fa-be4c8347b21b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:25 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-060ac85f-1634-4321-a5fa-be4c8347b21b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 Sep 28 12:24:25 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:25 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-060ac85f-1634-4321-a5fa-be4c8347b21b -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:25 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 is being set with open permissions: ugo+rw Sep 28 12:24:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:25 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 Sep 28 12:24:25 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:26 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25" returned: 0 in 0.240s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:26 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.info Sep 28 12:24:26 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:26 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.info" returned: 0 in 0.255s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:26 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.info is being set with open permissions: ugo+rw Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:26 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.info Sep 28 12:24:26 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:26 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.info" returned: 0 in 0.263s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.599s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736270236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:24Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Creating volume 11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:26 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:26 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 1073741824 Sep 28 12:24:26 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2e161e54-1867-4650-8580-4379803137f4 tempest-VolumesSnapshotTestJSON-381674265 None] Create snapshot completed successfully Sep 28 12:24:27 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 1073741824" returned: 0 in 0.466s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:27 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 Sep 28 12:24:27 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:27 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36" returned: 0 in 0.261s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.924s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1451562467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3347cad-0311-4a52-af62-136726913932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:24Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Creating volume a3347cad-0311-4a52-af62-136726913932 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:27 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8a949e-df3c-4020-b66d-b753499b29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:27 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 1073741824 Sep 28 12:24:27 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f312711e-ae12-4c73-8553-6ffd6e013a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:27 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 (11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36): created successfully Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f312711e-ae12-4c73-8553-6ffd6e013a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (2a85345f-edd6-4ccf-945a-2063b612a7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5df4f2b6-c9b5-451f-be82-e4b28a01bcd2 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created volume successfully. Sep 28 12:24:27 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 1073741824" returned: 0 in 0.546s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:27 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 Sep 28 12:24:27 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:28 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (2140880c-b218-432f-9a4e-e4dfa0f42e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a23a058-6166-420f-9e9e-9a33b16ef812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932" returned: 0 in 0.298s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.711s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-606061621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1245e219-8252-436f-bbf6-ffa3844c19af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:24Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Creating volume 1245e219-8252-436f-bbf6-ffa3844c19af {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:28 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a23a058-6166-420f-9e9e-9a33b16ef812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-163320162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f562eba36648f1b60a862e9383f882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=bb179241-92af-4796-a4a6-5b210b2e5b25,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:28Z,use_quota=True,user_id='f9b26f052cb94f7f9bfc1eb35f2fb644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d7c209-d0ac-486b-949d-e4d3a69eef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:28 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af 1073741824 Sep 28 12:24:28 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d7c209-d0ac-486b-949d-e4d3a69eef0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8969cf-4c3d-4f5f-9c6d-2e2abaeab9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8969cf-4c3d-4f5f-9c6d-2e2abaeab9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0', 'volume_name': 'volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0', 'volume_size': 2, 'snapshot_id': 'bb179241-92af-4796-a4a6-5b210b2e5b25'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb8cfb0-8be4-4a97-b46e-1e530955b4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb8cfb0-8be4-4a97-b46e-1e530955b4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3c81a6-bdae-43a6-b625-4d6c34608629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Volume 7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0', 'volume_size': 2, 'snapshot_id': 'bb179241-92af-4796-a4a6-5b210b2e5b25'} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac2f503-50ba-4246-ba22-305b29567ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3347cad-0311-4a52-af62-136726913932', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bca3228-e10d-4f03-adbc-9a654b51ca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Volume volume-a3347cad-0311-4a52-af62-136726913932 (a3347cad-0311-4a52-af62-136726913932): created successfully Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bca3228-e10d-4f03-adbc-9a654b51ca44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (a969b186-7f3d-4a70-8370-d51dc5a63ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7e35006b-82be-4e37-b9be-58a67942d518 tempest-VolumesActionsTest-1571147532 None] Created volume successfully. Sep 28 12:24:28 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af 1073741824" returned: 0 in 0.477s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:28 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af Sep 28 12:24:28 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:29 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af" returned: 0 in 0.261s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.195s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281336282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10efc3bc-3caf-4776-bb9c-71fdc3f4259a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:25Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Creating volume 10efc3bc-3caf-4776-bb9c-71fdc3f4259a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:29 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3829553-9e81-4e1c-bd42-abe04b67f132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1245e219-8252-436f-bbf6-ffa3844c19af', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:29 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a 1073741824 Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7eed54-81b7-4ae1-94b3-e571be1e429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:29 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume volume-1245e219-8252-436f-bbf6-ffa3844c19af (1245e219-8252-436f-bbf6-ffa3844c19af): created successfully Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa7eed54-81b7-4ae1-94b3-e571be1e429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (71f72ce6-a009-4327-9c4f-fb9b657958b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3608f65f-3a1f-4be0-ae1d-442ebc00fc40 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created volume successfully. Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-a3347cad-0311-4a52-af62-136726913932-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-a3347cad-0311-4a52-af62-136726913932-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "cinder-quobyte-a3347cad-0311-4a52-af62-136726913932" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-quobyte-a3347cad-0311-4a52-af62-136726913932" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c241057-8845-4805-9aa1-b98c894ac0c7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:29 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a 1073741824" returned: 0 in 0.552s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:29 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a Sep 28 12:24:29 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:29 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 Sep 28 12:24:29 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:29 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a" returned: 0 in 0.244s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.715s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2140894159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189fde17-4fcf-41af-86d6-9723c4dba94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a61e19a51764540b39b5789ae5967f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:25Z,use_quota=True,user_id='57bccaf97d0e49058ae1096d3675583b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Creating volume 189fde17-4fcf-41af-86d6-9723c4dba94a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:29 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d6b888-0346-4f70-bfe0-d3709ae1ac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97dc1759-9fd3-47f8-bcfc-18d39cfd5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:29 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a 1073741824 Sep 28 12:24:29 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a (10efc3bc-3caf-4776-bb9c-71fdc3f4259a): created successfully Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97dc1759-9fd3-47f8-bcfc-18d39cfd5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (14f0ef06-3bbe-4078-80f1-3237f5561b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1b343ab4-5fcd-4075-bd5b-26b1061d0e46 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created volume successfully. Sep 28 12:24:30 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932" returned: 0 in 0.431s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:30 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932 Sep 28 12:24:30 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:30 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a3347cad-0311-4a52-af62-136726913932" returned: 0 in 0.263s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-quobyte-a3347cad-0311-4a52-af62-136726913932" released by "delete_volume" :: held 0.737s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Created reservations ['0b2a29ad-dff5-4730-8799-c7035e5b8821', 'c089937b-4080-4aba-8862-f17948bcc1e1', '2d2751eb-c214-484f-923f-cc46371c98c1', 'b2fcb0d8-414e-4ee9-962f-23c06a974b48'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:30 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a 1073741824" returned: 0 in 0.458s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:30 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a Sep 28 12:24:30 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:30 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:30 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:30 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a" returned: 0 in 0.263s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.331s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-bb179241-92af-4796-a4a6-5b210b2e5b25-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-bb179241-92af-4796-a4a6-5b210b2e5b25-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Creating volume 7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 from snapshot bb179241-92af-4796-a4a6-5b210b2e5b25 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebff0c08-7ad8-4ce8-bc25-5c374189180a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189fde17-4fcf-41af-86d6-9723c4dba94a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234083ff-5f12-4943-9557-fb7edbf23d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:30 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.297s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Deleted volume successfully. Sep 28 12:24:30 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Volume volume-189fde17-4fcf-41af-86d6-9723c4dba94a (189fde17-4fcf-41af-86d6-9723c4dba94a): created successfully Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234083ff-5f12-4943-9557-fb7edbf23d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Flow 'volume_create_manager' (b9ca9094-a28e-4098-a066-47f7fc33e86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] snapshot: bb179241-92af-4796-a4a6-5b210b2e5b25, volume: 7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:24:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4ed377b4-8222-41f2-ba7b-52516b1a6f17 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created volume successfully. Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ccbc75d2-f623-4fd1-8cc0-5c21f2dc3095 tempest-VolumesActionsTest-1399458088 None] Lock "cinder-a3347cad-0311-4a52-af62-136726913932-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e057a-6a2c-437b-b2da-cb6c81e4213e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:31 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 Sep 28 12:24:31 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (bf9f5ee8-b517-4d2d-b3cf-889d32731151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b1e770-095b-492c-8509-2c727d945575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:31 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25" returned: 0 in 0.439s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-060ac85f-1634-4321-a5fa-be4c8347b21b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b1e770-095b-492c-8509-2c727d945575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1329568350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14ac766-cf3a-43bd-b08f-1a65cccf14f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:31Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed10fb84-618d-4da2-a9bc-6943dca554f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed10fb84-618d-4da2-a9bc-6943dca554f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096083f5-f649-4250-a712-f4d34e8e490a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096083f5-f649-4250-a712-f4d34e8e490a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14ac766-cf3a-43bd-b08f-1a65cccf14f6', 'volume_name': 'volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78b64e0-13c2-478e-9270-da197d1c0528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78b64e0-13c2-478e-9270-da197d1c0528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab7b76a-e8c7-491f-8aa5-989852a3bed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Volume a14ac766-cf3a-43bd-b08f-1a65cccf14f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6', 'volume_size': 1} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af3dd0-48e5-4d97-9c37-f1aba514d500]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:31 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b Sep 28 12:24:31 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-189fde17-4fcf-41af-86d6-9723c4dba94a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:31 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b" returned: 0 in 0.385s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-189fde17-4fcf-41af-86d6-9723c4dba94a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:31 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 Sep 28 12:24:31 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-quobyte-189fde17-4fcf-41af-86d6-9723c4dba94a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-189fde17-4fcf-41af-86d6-9723c4dba94a" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3a9f7b-ef4a-484d-85e4-d5cf11b46a34]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:31 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a Sep 28 12:24:31 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:32 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a" returned: 0 in 0.490s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:32 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a Sep 28 12:24:32 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:32 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-189fde17-4fcf-41af-86d6-9723c4dba94a" returned: 0 in 0.389s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-189fde17-4fcf-41af-86d6-9723c4dba94a" released by "delete_volume" :: held 0.943s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:32 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created reservations ['98628b61-39a1-423f-8086-862f16a5c88b', '078ba725-1ad1-4dc4-b6e2-16dd9c352ec0', '7835785a-f9ec-429b-b121-8dc220d9f7e5', 'fdf62746-522e-4c56-ab65-b3f783728105'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:33 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:33 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:33 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.377s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Deleted volume successfully. Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=143,cinder:UPDATE=182,cinder:DELETE=21,cinder:INSERT=46 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:24:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9a4d933b-6f55-4693-aca3-52e389f40dab tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-189fde17-4fcf-41af-86d6-9723c4dba94a-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-10efc3bc-3caf-4776-bb9c-71fdc3f4259a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-10efc3bc-3caf-4776-bb9c-71fdc3f4259a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=145,cinder:UPDATE=205,cinder:INSERT=42,cinder:DELETE=16 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-quobyte-10efc3bc-3caf-4776-bb9c-71fdc3f4259a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-10efc3bc-3caf-4776-bb9c-71fdc3f4259a" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[371e3b12-9167-4b09-913e-1b245228e166]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:34 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a Sep 28 12:24:34 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:34 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a" returned: 0 in 0.644s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:35 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a Sep 28 12:24:35 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:35 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-10efc3bc-3caf-4776-bb9c-71fdc3f4259a" returned: 0 in 0.378s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-10efc3bc-3caf-4776-bb9c-71fdc3f4259a" released by "delete_volume" :: held 1.112s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created reservations ['2c0c57dc-0b59-4cde-bd96-a9e15fd12056', '48378b86-e79c-4839-aa02-d8db2c1b212a', 'b56ac155-b237-44ae-9324-161ceecac002', '9116ef12-4153-43b5-a462-8593b3266529'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:35 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:35 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:36 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.408s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Deleted volume successfully. Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5dbe8c43-a0cb-425b-9371-fa8b4a6e2cbb tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-10efc3bc-3caf-4776-bb9c-71fdc3f4259a-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-1245e219-8252-436f-bbf6-ffa3844c19af-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-1245e219-8252-436f-bbf6-ffa3844c19af-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-quobyte-1245e219-8252-436f-bbf6-ffa3844c19af" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-1245e219-8252-436f-bbf6-ffa3844c19af" acquired by "delete_volume" :: waited 0.054s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ee64eb-216f-411a-ab80-93383c32c36a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:36 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af Sep 28 12:24:36 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:37 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af" returned: 0 in 0.598s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:37 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af Sep 28 12:24:37 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:38 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1245e219-8252-436f-bbf6-ffa3844c19af" returned: 0 in 0.626s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-1245e219-8252-436f-bbf6-ffa3844c19af" released by "delete_volume" :: held 1.343s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created reservations ['fc3b9933-88c0-436f-ab20-68899464d723', 'debb6ae1-dbdd-43b9-9e4c-ccc64051edd2', '19c712a1-3559-4c87-8b50-b374d22e309f', '8251e44a-9dd7-42aa-b268-41a5dd2cb76d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:38 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:38 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:38 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.415s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Deleted volume successfully. Sep 28 12:24:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81a50beb-b43c-4302-b85a-56eb5b359360 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-1245e219-8252-436f-bbf6-ffa3844c19af-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-quobyte-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdadb76d-c491-4f97-a523-d3c61a8a59c9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:39 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" returned: 0 in 7.552s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:24:39 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Converted 1024.00 MB image at 135.57 MB/s Sep 28 12:24:39 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 is being set with open permissions: ugo+rw Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:39 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 Sep 28 12:24:39 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:39 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 Sep 28 12:24:39 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:39 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" returned: 0 in 0.281s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" released by "_copy_volume_from_snapshot" :: held 8.810s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-bb179241-92af-4796-a4a6-5b210b2e5b25-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" released by "_create_volume_from_snapshot" :: held 8.933s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.963s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.303s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1329568350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14ac766-cf3a-43bd-b08f-1a65cccf14f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee7dab9645b4e08a93c368c93bb14a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:31Z,use_quota=True,user_id='c0bd22dc1d054352a3746f16fb925f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:39 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Creating volume a14ac766-cf3a-43bd-b08f-1a65cccf14f6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:39 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36" returned: 0 in 0.432s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:39 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 1073741824 Sep 28 12:24:39 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:39 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36 Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3c81a6-bdae-43a6-b625-4d6c34608629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0', 'volume_size': 2, 'snapshot_id': 'bb179241-92af-4796-a4a6-5b210b2e5b25'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:39 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66d75fe-7139-4f82-9fba-ff554b5a5c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:39 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Volume volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 (7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0): created successfully Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66d75fe-7139-4f82-9fba-ff554b5a5c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (2140880c-b218-432f-9a4e-e4dfa0f42e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-781b9302-b729-4928-a67d-326cb2e4c71b tempest-VolumesSnapshotTestJSON-381674265 None] Created volume successfully. Sep 28 12:24:40 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36" returned: 0 in 0.345s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36" released by "delete_volume" :: held 0.836s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created reservations ['cd2326fd-832e-489d-9194-015d4ffdd4cc', '59e7ae08-4520-4120-ac69-a8e238487739', 'cbc1a37e-01e8-472a-b29c-604c280a0e43', 'cd6256f9-a3fd-4e48-a1ac-c6726fb34b98'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:40 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 1073741824" returned: 0 in 0.554s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:40 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:40 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:40 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 Sep 28 12:24:40 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-94858fd9-025a-4712-ba5d-5ed1d16f927c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-94858fd9-025a-4712-ba5d-5ed1d16f927c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-quobyte-94858fd9-025a-4712-ba5d-5ed1d16f927c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-94858fd9-025a-4712-ba5d-5ed1d16f927c" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc2a448-2246-4a01-820b-8e643537bd4c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:40 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[52008ec4-da72-4871-a93a-2b480bdff870]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.410s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:40 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:40 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Deleted volume successfully. Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fb21a150-cda3-4fc6-9045-e73e5940f483 tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-11e8d7b9-1f09-4be6-b4ab-5a49e8ec8a36-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:40 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 Sep 28 12:24:40 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:40 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6" returned: 0 in 0.458s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab7b76a-e8c7-491f-8aa5-989852a3bed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89246835-2760-48ec-a2c6-6188a8d83344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Volume volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 (a14ac766-cf3a-43bd-b08f-1a65cccf14f6): created successfully Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89246835-2760-48ec-a2c6-6188a8d83344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Flow 'volume_create_manager' (bf9f5ee8-b517-4d2d-b3cf-889d32731151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:40 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2c82da3-474a-454e-8255-912adac470d5 tempest-VolumesActionsTest-1571147532 None] Created volume successfully. Sep 28 12:24:40 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c" returned: 0 in 0.456s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:40 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c Sep 28 12:24:40 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:41 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" returned: 0 in 0.445s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:41 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0 Sep 28 12:24:41 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:41 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94858fd9-025a-4712-ba5d-5ed1d16f927c" returned: 0 in 0.320s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-94858fd9-025a-4712-ba5d-5ed1d16f927c" released by "delete_volume" :: held 0.862s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created reservations ['289da184-d74b-4f84-bdb5-d8c33dfc7670', '7ca57544-5e37-414c-b31b-924fb60c1a4d', '0e5e68a1-081d-4063-bfc2-f55779befb58', '44fe5a9e-13fd-4132-a6c5-bace0e984394'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:41 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0" released by "delete_volume" :: held 0.819s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:41 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:41 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Created reservations ['07ed7980-97d1-4130-893a-12aad4fc5de1', '815abb36-2cbb-4bfb-b6d9-b21e3513c493', 'a3f6322f-8e5a-47b9-bab1-03ce67cead20', '36aba080-f5b1-4d13-80ac-a8fa26ec65e3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-4717c846-09b5-4024-854d-92b6e7b96bfa-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-4717c846-09b5-4024-854d-92b6e7b96bfa-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "cinder-quobyte-4717c846-09b5-4024-854d-92b6e7b96bfa" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-4717c846-09b5-4024-854d-92b6e7b96bfa" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:41 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:41 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-bb179241-92af-4796-a4a6-5b210b2e5b25-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127ae09-17ab-477f-bf61-0026695738ef]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:41 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.394s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-bb179241-92af-4796-a4a6-5b210b2e5b25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-060ac85f-1634-4321-a5fa-be4c8347b21b" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Deleted volume successfully. Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-060ac85f-1634-4321-a5fa-be4c8347b21b" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-bb179241-92af-4796-a4a6-5b210b2e5b25" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88b88ecb-f194-43b9-9767-054e0e54936e tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-94858fd9-025a-4712-ba5d-5ed1d16f927c-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-bb179241-92af-4796-a4a6-5b210b2e5b25" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Deleting offline snapshot bb179241-92af-4796-a4a6-5b210b2e5b25 of volume 060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] snapshot_file for this snap is: volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:24:42 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa Sep 28 12:24:42 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5735d6c-2c1b-449f-b9cc-61e3849be6d7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:42 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Acquiring lock "cinder-a14ac766-cf3a-43bd-b08f-1a65cccf14f6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.343s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Deleted volume successfully. Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Lock "cinder-a14ac766-cf3a-43bd-b08f-1a65cccf14f6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7d0909f-1911-4946-91f3-5987ed6c28c1 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-7d38bb9f-1382-47f4-b89a-9a89ab0cbaa0-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Acquiring lock "cinder-quobyte-a14ac766-cf3a-43bd-b08f-1a65cccf14f6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:42 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 Sep 28 12:24:42 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Lock "cinder-quobyte-a14ac766-cf3a-43bd-b08f-1a65cccf14f6" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6f4a7e-4416-4055-bf25-5a02a47a38ce]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:42 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa" returned: 0 in 0.476s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:42 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa Sep 28 12:24:42 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 Sep 28 12:24:42 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25" returned: 0 in 0.428s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-060ac85f-1634-4321-a5fa-be4c8347b21b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df644b-ea82-4e42-b476-e4a5d9ce8465]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:42 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-4717c846-09b5-4024-854d-92b6e7b96bfa" returned: 0 in 0.284s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-quobyte-4717c846-09b5-4024-854d-92b6e7b96bfa" released by "delete_volume" :: held 0.839s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:42 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b Sep 28 12:24:42 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:42 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6" returned: 0 in 0.414s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:42 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6 Sep 28 12:24:42 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Created reservations ['eb6a2465-3051-44ba-bda4-f122b81aa17e', '50cabd4d-f143-4181-9817-655455ec3c78', '615163ba-9709-419d-a879-3cee70d63017', '93ad6b81-5382-4f49-9e53-4c393989fdbc'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:42 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:42 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a14ac766-cf3a-43bd-b08f-1a65cccf14f6" returned: 0 in 0.307s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Lock "cinder-quobyte-a14ac766-cf3a-43bd-b08f-1a65cccf14f6" released by "delete_volume" :: held 0.771s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Created reservations ['dd238669-004f-490b-82f5-073aee89bbcf', 'a17ac3c1-b845-454e-84b7-ad31a37ab934', 'd16bf4ed-b2ed-47af-9b36-fa0b52ee61a5', 'd89bce02-9bc9-409e-b8a3-90755603b7ce'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:43 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.295s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Deleted volume successfully. Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:43 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:43 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:43 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ed3163dd-b6dd-44c4-a65b-78271e3ef64b tempest-CreateVolumesFromSourceVolumeTest-389216772 None] Lock "cinder-4717c846-09b5-4024-854d-92b6e7b96bfa-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:43 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 Sep 28 12:24:43 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:43 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.277s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Deleted volume successfully. Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dac37d67-9273-408f-bd95-fc1212e1ffda tempest-VolumesActionsTest-1571147532 None] Lock "cinder-a14ac766-cf3a-43bd-b08f-1a65cccf14f6-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:43 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25" returned: 0 in 0.439s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:43 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25 Sep 28 12:24:43 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:43 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b.bb179241-92af-4796-a4a6-5b210b2e5b25" returned: 0 in 0.272s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-bb179241-92af-4796-a4a6-5b210b2e5b25" released by "_delete_snapshot" :: held 1.922s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-060ac85f-1634-4321-a5fa-be4c8347b21b" released by "delete_snapshot" :: held 1.962s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:44 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Created reservations ['2f7b36e5-02ca-4b0f-ab72-89b86493fc8a', '7f8441d0-06df-4a1c-b89e-ad4d4b8f12ae', '73871ee7-fe34-4521-a6f9-8b1e01ef1250', 'b94054f5-824b-4b20-b530-43d54b9dbc4a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Delete snapshot completed successfully. Sep 28 12:24:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c5710941-6d05-4c36-a021-9e7fec874569 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-bb179241-92af-4796-a4a6-5b210b2e5b25-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-060ac85f-1634-4321-a5fa-be4c8347b21b-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-060ac85f-1634-4321-a5fa-be4c8347b21b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-060ac85f-1634-4321-a5fa-be4c8347b21b" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-060ac85f-1634-4321-a5fa-be4c8347b21b" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67c9017-369f-41f7-b55c-ce76b20fa6f5]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:45 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b Sep 28 12:24:45 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:45 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b" returned: 0 in 0.545s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:45 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b Sep 28 12:24:45 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:46 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-060ac85f-1634-4321-a5fa-be4c8347b21b" returned: 0 in 0.393s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-060ac85f-1634-4321-a5fa-be4c8347b21b" released by "delete_volume" :: held 1.031s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Created reservations ['f3e34e20-a012-46a8-91cd-49cc0fa46ded', 'f8648403-657f-41cd-ba87-ca769e50e8b1', 'da9885ec-8f24-40fe-909d-3a52c3223451', '0daa6091-17ec-462a-abe8-cbe517992d8e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:46 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:46 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:46 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Deleted volume successfully. Sep 28 12:24:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-77f731e0-c9b8-4d5e-9116-b2169f4500d2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-060ac85f-1634-4321-a5fa-be4c8347b21b-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (71798417-d2ac-494b-b8e2-49b75dfb2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2dbd30-2263-4294-9269-0c08a0729e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2dbd30-2263-4294-9269-0c08a0729e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-368961863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69199104-83ce-44b8-950d-6941725f982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f562eba36648f1b60a862e9383f882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:48Z,use_quota=True,user_id='f9b26f052cb94f7f9bfc1eb35f2fb644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dabb9fe-590f-41d3-9429-73b93e404ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dabb9fe-590f-41d3-9429-73b93e404ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c2213d-b792-4c46-8417-c441e02dbafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c2213d-b792-4c46-8417-c441e02dbafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69199104-83ce-44b8-950d-6941725f982a', 'volume_name': 'volume-69199104-83ce-44b8-950d-6941725f982a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae73b9f-ca78-42bf-9a85-03c5ba4f7c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae73b9f-ca78-42bf-9a85-03c5ba4f7c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10c1faa-12fe-4059-9b9b-4bd4a8f5a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Volume 69199104-83ce-44b8-950d-6941725f982a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69199104-83ce-44b8-950d-6941725f982a', 'volume_size': 1} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-368961863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69199104-83ce-44b8-950d-6941725f982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f562eba36648f1b60a862e9383f882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:48Z,use_quota=True,user_id='f9b26f052cb94f7f9bfc1eb35f2fb644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Creating volume 69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:48 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:48 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a 1073741824 Sep 28 12:24:48 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:48 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a 1073741824" returned: 0 in 0.504s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:48 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a Sep 28 12:24:48 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:49 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a" returned: 0 in 0.382s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10c1faa-12fe-4059-9b9b-4bd4a8f5a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69199104-83ce-44b8-950d-6941725f982a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c9b084-4b0b-41d0-be27-0115bf41b96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Volume volume-69199104-83ce-44b8-950d-6941725f982a (69199104-83ce-44b8-950d-6941725f982a): created successfully Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c9b084-4b0b-41d0-be27-0115bf41b96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (71798417-d2ac-494b-b8e2-49b75dfb2522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a7f9502e-359c-41f6-9056-8920fd99dea2 tempest-VolumesSnapshotTestJSON-381674265 None] Created volume successfully. Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:49 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:24:49 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:49 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:24:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Creating offline snapshot 2cf8ee5a-0b04-47b8-b73c-69789249dbef of volume 69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bd5880-4118-484f-8d57-25ec7dba3e22]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:50 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a Sep 28 12:24:50 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Flow 'volume_create_manager' (ffb547e2-229a-4d9f-993c-ca382548b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09fccd6-a493-4455-8331-b2e6aa66cd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09fccd6-a493-4455-8331-b2e6aa66cd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee02c26-2d52-45d9-8492-4ea528026401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30330a4d67b94c888b13f42be7503d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:51Z,use_quota=True,user_id='fbdeb49036ea4229aeb4e8e3814fa1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d475af6a-1f84-4c93-996d-27588783a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d475af6a-1f84-4c93-996d-27588783a074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec80c79-3801-4c81-8f02-5a9ce27fc1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:24:50 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a" returned: 0 in 0.536s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec80c79-3801-4c81-8f02-5a9ce27fc1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ee02c26-2d52-45d9-8492-4ea528026401', 'volume_name': 'volume-0ee02c26-2d52-45d9-8492-4ea528026401', 'volume_size': 1, 'image_id': '4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a98e22a5223fb94e68c4b6cb2bba9a7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30330a4d67b94c888b13f42be7503d09', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a7e5226c84450eccbf944f5671b1236f7cfcf43962051996ef88f52d4b4bda8286cb7030376117c707f9e96df04491570098c74c52c6aee1ce1faf9bdc514f1', 'id': '4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'created_at': datetime.datetime(2026, 9, 28, 10, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 24, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:50 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef 1G Sep 28 12:24:50 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5808865-0c07-41ef-946e-0c1a7b044d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5808865-0c07-41ef-946e-0c1a7b044d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffee24d-72a1-41c1-b3c2-81a5d2a13ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Volume 0ee02c26-2d52-45d9-8492-4ea528026401: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ee02c26-2d52-45d9-8492-4ea528026401', 'volume_size': 1, 'image_id': '4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a98e22a5223fb94e68c4b6cb2bba9a7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30330a4d67b94c888b13f42be7503d09', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a7e5226c84450eccbf944f5671b1236f7cfcf43962051996ef88f52d4b4bda8286cb7030376117c707f9e96df04491570098c74c52c6aee1ce1faf9bdc514f1', 'id': '4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'created_at': datetime.datetime(2026, 9, 28, 10, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 24, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13/file', 'properties': {}}, 'image_service': } Sep 28 12:24:50 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Trying to clone 0ee02c26-2d52-45d9-8492-4ea528026401 from image 4e913df2-fef5-4cbc-9d3a-d213c0f89b13 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:24:51 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeff488-575d-4fdf-a987-4c58c640b14e]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:51 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD Sep 28 12:24:51 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:51 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef 1G" returned: 0 in 0.586s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69199104-83ce-44b8-950d-6941725f982a -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:51 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69199104-83ce-44b8-950d-6941725f982a -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef Sep 28 12:24:51 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:51 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:51 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD Sep 28 12:24:51 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:51 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69199104-83ce-44b8-950d-6941725f982a -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef" returned: 0 in 0.358s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:51 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef is being set with open permissions: ugo+rw Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:51 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef Sep 28 12:24:51 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:51 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:24:51 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Temporary image 4e913df2-fef5-4cbc-9d3a-d213c0f89b13 is fetched for user fbdeb49036ea4229aeb4e8e3814fa1ef. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fe82d2-77b7-40e8-9c84-82e468f649cf]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:52 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef" returned: 0 in 0.319s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:52 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD Sep 28 12:24:52 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:52 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.info Sep 28 12:24:52 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:52 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:52 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.info" returned: 0 in 0.292s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:52 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.info is being set with open permissions: ugo+rw Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:52 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.info Sep 28 12:24:52 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:52 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD Sep 28 12:24:52 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:52 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.info" returned: 0 in 0.341s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:52 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD" returned: 1 in 0.416s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee02c26-2d52-45d9-8492-4ea528026401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30330a4d67b94c888b13f42be7503d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:51Z,use_quota=True,user_id='fbdeb49036ea4229aeb4e8e3814fa1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Creating volume 0ee02c26-2d52-45d9-8492-4ea528026401 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:52 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:24:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:52 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 1073741824 Sep 28 12:24:52 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2d8f4778-f4d1-43f6-b374-6889ac1717df tempest-VolumesSnapshotTestJSON-381674265 None] Create snapshot completed successfully Sep 28 12:24:53 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 1073741824" returned: 0 in 0.566s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:53 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 Sep 28 12:24:53 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:53 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401" returned: 0 in 0.320s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:53 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Attempting download of 4e913df2-fef5-4cbc-9d3a-d213c0f89b13 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'metadata': {}}])) to volume 0ee02c26-2d52-45d9-8492-4ea528026401. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:24:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[94354e0a-c243-4147-9028-9dd2da05ed74]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_lszjfwzk {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:54 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_lszjfwzk Sep 28 12:24:54 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (add059f1-5c4c-45de-86b0-84c80dc7fadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a248ba-124c-4f6a-bff5-0450a0715b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a248ba-124c-4f6a-bff5-0450a0715b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1583411468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed0ce983-9155-4c2d-90c1-e9d0fabbf3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f562eba36648f1b60a862e9383f882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2cf8ee5a-0b04-47b8-b73c-69789249dbef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:54Z,use_quota=True,user_id='f9b26f052cb94f7f9bfc1eb35f2fb644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0290a1-3b4e-4321-aaf2-b090bb4fab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0290a1-3b4e-4321-aaf2-b090bb4fab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822e1ff0-2618-453a-b18e-f67398b680fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822e1ff0-2618-453a-b18e-f67398b680fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed0ce983-9155-4c2d-90c1-e9d0fabbf3be', 'volume_name': 'volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be', 'volume_size': 1, 'snapshot_id': '2cf8ee5a-0b04-47b8-b73c-69789249dbef'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb5d536-4d8f-4fe5-8949-74bf82fa414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb5d536-4d8f-4fe5-8949-74bf82fa414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2f413d-ef0b-47f4-bd90-0a9b7aa5ba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:54 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Volume ed0ce983-9155-4c2d-90c1-e9d0fabbf3be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be', 'volume_size': 1, 'snapshot_id': '2cf8ee5a-0b04-47b8-b73c-69789249dbef'} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-2cf8ee5a-0b04-47b8-b73c-69789249dbef-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:54 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_lszjfwzk" returned: 0 in 0.485s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_lszjfwzk {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-2cf8ee5a-0b04-47b8-b73c-69789249dbef-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Creating volume ed0ce983-9155-4c2d-90c1-e9d0fabbf3be from snapshot 2cf8ee5a-0b04-47b8-b73c-69789249dbef {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] snapshot: 2cf8ee5a-0b04-47b8-b73c-69789249dbef, volume: ed0ce983-9155-4c2d-90c1-e9d0fabbf3be, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ae9bc-b797-4605-9fcf-d9b6e99ffb6b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:54 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_lszjfwzk Sep 28 12:24:54 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:54 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef Sep 28 12:24:54 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:54 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_lszjfwzk" returned: 1 in 0.495s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_lszjfwzk' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[032e53b7-9575-4914-85c6-86b82509d427]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:55 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD Sep 28 12:24:55 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:55 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef" returned: 0 in 0.465s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69199104-83ce-44b8-950d-6941725f982a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6a1bca-438b-4899-b9cb-da75095f0760]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:55 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a Sep 28 12:24:55 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:55 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:55 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD Sep 28 12:24:55 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:55 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a" returned: 0 in 0.429s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:55 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be Sep 28 12:24:55 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:55 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD" returned: 1 in 0.413s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] 4e913df2-fef5-4cbc-9d3a-d213c0f89b13 was raw, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:24:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:55 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 Sep 28 12:24:55 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:56 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401" returned: 0 in 0.995s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:56 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e913df2-fef5-4cbc-9d3a-d213c0f89b13_75v_6sx4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:24:56 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:24:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:56 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 1G Sep 28 12:24:56 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:57 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 1G" returned: 0 in 0.853s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Downloaded image 4e913df2-fef5-4cbc-9d3a-d213c0f89b13 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'metadata': {}}])) to volume 0ee02c26-2d52-45d9-8492-4ea528026401 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Temporary image 4e913df2-fef5-4cbc-9d3a-d213c0f89b13 for user fbdeb49036ea4229aeb4e8e3814fa1ef is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Marking volume 0ee02c26-2d52-45d9-8492-4ea528026401 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Copying metadata from image 4e913df2-fef5-4cbc-9d3a-d213c0f89b13 to 0ee02c26-2d52-45d9-8492-4ea528026401. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Creating volume glance metadata for volume 0ee02c26-2d52-45d9-8492-4ea528026401 backed by image 4e913df2-fef5-4cbc-9d3a-d213c0f89b13 with: {'image_id': '4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a98e22a5223fb94e68c4b6cb2bba9a7a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffee24d-72a1-41c1-b3c2-81a5d2a13ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee02c26-2d52-45d9-8492-4ea528026401', 'volume_size': 1, 'image_id': '4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a98e22a5223fb94e68c4b6cb2bba9a7a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30330a4d67b94c888b13f42be7503d09', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a7e5226c84450eccbf944f5671b1236f7cfcf43962051996ef88f52d4b4bda8286cb7030376117c707f9e96df04491570098c74c52c6aee1ce1faf9bdc514f1', 'id': '4e913df2-fef5-4cbc-9d3a-d213c0f89b13', 'created_at': datetime.datetime(2026, 9, 28, 10, 24, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 24, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e913df2-fef5-4cbc-9d3a-d213c0f89b13/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829f77fe-bac1-46d1-b910-b39100fbe6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Volume volume-0ee02c26-2d52-45d9-8492-4ea528026401 (0ee02c26-2d52-45d9-8492-4ea528026401): created successfully Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829f77fe-bac1-46d1-b910-b39100fbe6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Flow 'volume_create_manager' (ffb547e2-229a-4d9f-993c-ca382548b31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-32bde330-317b-49be-a6c4-c622afa96fa2 tempest-VolumeImageDependencyTests-350917262 None] Created volume successfully. Sep 28 12:24:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Acquiring lock "cinder-0ee02c26-2d52-45d9-8492-4ea528026401-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Lock "cinder-0ee02c26-2d52-45d9-8492-4ea528026401-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Acquiring lock "cinder-quobyte-0ee02c26-2d52-45d9-8492-4ea528026401" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Lock "cinder-quobyte-0ee02c26-2d52-45d9-8492-4ea528026401" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7844452b-00f0-402f-ba6a-9894ca20eeab]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:58 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 Sep 28 12:24:58 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:59 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401" returned: 0 in 0.938s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:59 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401 Sep 28 12:24:59 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:00 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0ee02c26-2d52-45d9-8492-4ea528026401" returned: 0 in 0.484s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Lock "cinder-quobyte-0ee02c26-2d52-45d9-8492-4ea528026401" released by "delete_volume" :: held 1.532s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Created reservations ['b2177855-60ac-4a06-85bb-1a5718e59273', 'fa9a4938-4846-41e5-af1d-20900ef85060', '458d682f-3e21-49f2-b5ef-7b9c47f12c03', '6ee6680a-ba3f-4963-9c57-68954405e90e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:00 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:00 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:00 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.525s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Deleted volume successfully. Sep 28 12:25:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-38f29bfc-3859-4308-bd64-a2fe17890966 tempest-VolumeImageDependencyTests-350917262 None] Lock "cinder-0ee02c26-2d52-45d9-8492-4ea528026401-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" returned: 0 in 8.936s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:25:04 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Converted 1024.00 MB image at 114.58 MB/s Sep 28 12:25:04 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be is being set with open permissions: ugo+rw Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:04 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be Sep 28 12:25:04 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Flow 'volume_create_manager' (c5b2029b-3e34-4202-b354-19d2a22a4776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b1f35e-73e2-44b3-af6f-49a18ad650b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b1f35e-73e2-44b3-af6f-49a18ad650b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1467330254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9db09f-bf43-499d-915b-c6f9a5d2964d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9c790ba3a94c3bb2c90d13bad3c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:05Z,use_quota=True,user_id='f6f9258021b9442f8fefe575b2f9ac7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd98d2f-8b07-48df-b60f-3f47a5efa90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd98d2f-8b07-48df-b60f-3f47a5efa90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97362d94-cbf7-42ca-882d-ba15a31f6430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97362d94-cbf7-42ca-882d-ba15a31f6430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9db09f-bf43-499d-915b-c6f9a5d2964d', 'volume_name': 'volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec10d51-f040-473a-b559-035961933230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec10d51-f040-473a-b559-035961933230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302d3442-560d-4e24-b05b-5f2a91b225fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Volume fa9db09f-bf43-499d-915b-c6f9a5d2964d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d', 'volume_size': 1} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:04 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" returned: 0 in 0.279s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" released by "_copy_volume_from_snapshot" :: held 10.261s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-2cf8ee5a-0b04-47b8-b73c-69789249dbef-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" released by "_create_volume_from_snapshot" :: held 10.347s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.401s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1467330254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9db09f-bf43-499d-915b-c6f9a5d2964d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9c790ba3a94c3bb2c90d13bad3c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:05Z,use_quota=True,user_id='f6f9258021b9442f8fefe575b2f9ac7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Creating volume fa9db09f-bf43-499d-915b-c6f9a5d2964d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:04 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:04 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d 1073741824 Sep 28 12:25:04 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2f413d-ef0b-47f4-bd90-0a9b7aa5ba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be', 'volume_size': 1, 'snapshot_id': '2cf8ee5a-0b04-47b8-b73c-69789249dbef'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c77ef6c-4e47-4c60-a3ee-1267c5df73a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Volume volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be (ed0ce983-9155-4c2d-90c1-e9d0fabbf3be): created successfully Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c77ef6c-4e47-4c60-a3ee-1267c5df73a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Flow 'volume_create_manager' (add059f1-5c4c-45de-86b0-84c80dc7fadf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b054c72d-334e-4c6d-a44b-6d16ec0a7490 tempest-VolumesSnapshotTestJSON-381674265 None] Created volume successfully. Sep 28 12:25:05 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d 1073741824" returned: 0 in 0.472s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:05 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d Sep 28 12:25:05 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:05 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37379e7-4d8e-413c-b2d6-a702e689cb09]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302d3442-560d-4e24-b05b-5f2a91b225fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187fa49-97e8-4070-862b-0a797df59521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:05 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Volume volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d (fa9db09f-bf43-499d-915b-c6f9a5d2964d): created successfully Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187fa49-97e8-4070-862b-0a797df59521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:05 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Flow 'volume_create_manager' (c5b2029b-3e34-4202-b354-19d2a22a4776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c0e3482f-e759-4408-83d2-7545ff384de1 tempest-VolumesListAdminTestJSON-1956453614 None] Created volume successfully. Sep 28 12:25:05 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be Sep 28 12:25:05 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:06 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" returned: 0 in 0.435s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:06 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be Sep 28 12:25:06 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Flow 'volume_create_manager' (09113c90-fe35-4471-8cab-211def802f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6cb0e4-f4b9-47cb-be51-8f159f3fb521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6cb0e4-f4b9-47cb-be51-8f159f3fb521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaac3560-fbeb-4595-95a1-799307146ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256644b9272240068ff79ef1d8c06369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:06Z,use_quota=True,user_id='22aae50c50034addaccab0fd3e1b4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe921f9-936b-4cad-b010-2676e72b5857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fe921f9-936b-4cad-b010-2676e72b5857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a951792b-235b-4540-8b33-3b468875d2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a951792b-235b-4540-8b33-3b468875d2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaac3560-fbeb-4595-95a1-799307146ea1', 'volume_name': 'volume-aaac3560-fbeb-4595-95a1-799307146ea1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a67911d-ff5b-460b-8155-c159eecd8087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a67911d-ff5b-460b-8155-c159eecd8087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067334f2-ff47-45ba-9820-d7049dd91f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Volume aaac3560-fbeb-4595-95a1-799307146ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaac3560-fbeb-4595-95a1-799307146ea1', 'volume_size': 1} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaac3560-fbeb-4595-95a1-799307146ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256644b9272240068ff79ef1d8c06369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:06Z,use_quota=True,user_id='22aae50c50034addaccab0fd3e1b4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Creating volume aaac3560-fbeb-4595-95a1-799307146ea1 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:06 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:06 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 1073741824 Sep 28 12:25:06 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:06 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" returned: 0 in 0.279s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be" released by "delete_volume" :: held 0.770s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Created reservations ['6a45421a-f92b-4847-996e-c14df35a8f45', '1ba0d1be-3171-40c3-8301-96b2cbc9f6fe', '5b6acbbf-a1e9-45fe-9818-24c861d1db8e', 'f22794d3-0909-4ddf-91a4-0200a8155331'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:06 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:06 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-2cf8ee5a-0b04-47b8-b73c-69789249dbef-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-2cf8ee5a-0b04-47b8-b73c-69789249dbef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-69199104-83ce-44b8-950d-6941725f982a" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:06 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.330s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Deleted volume successfully. Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-69199104-83ce-44b8-950d-6941725f982a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-2cf8ee5a-0b04-47b8-b73c-69789249dbef" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-2cf8ee5a-0b04-47b8-b73c-69789249dbef" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Deleting offline snapshot 2cf8ee5a-0b04-47b8-b73c-69789249dbef of volume 69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] snapshot_file for this snap is: volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fe4414f5-d719-488b-a31e-fdf0f37093bd tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-ed0ce983-9155-4c2d-90c1-e9d0fabbf3be-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e74745-47cf-4e2d-8a6c-ac288e5c442e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:06 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 1073741824" returned: 0 in 0.629s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:07 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 Sep 28 12:25:07 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:07 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef Sep 28 12:25:07 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:07 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1" returned: 0 in 0.294s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067334f2-ff47-45ba-9820-d7049dd91f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaac3560-fbeb-4595-95a1-799307146ea1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be88757b-152c-4a8c-bb20-b22fa0cf8859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Volume volume-aaac3560-fbeb-4595-95a1-799307146ea1 (aaac3560-fbeb-4595-95a1-799307146ea1): created successfully Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be88757b-152c-4a8c-bb20-b22fa0cf8859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Flow 'volume_create_manager' (09113c90-fe35-4471-8cab-211def802f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9fc80995-75cc-4e13-bbfa-4998124c57ed tempest-CinderUnicodeTest-448231503 None] Created volume successfully. Sep 28 12:25:07 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef" returned: 0 in 0.444s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69199104-83ce-44b8-950d-6941725f982a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Flow 'volume_create_manager' (d1dc1f0d-2bc7-4e94-8766-72c06cfb08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0596b18-ebe4-496f-ad56-d3c4bf7b16c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb0ac5-e44a-4921-8fda-981d67d3c8e2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0596b18-ebe4-496f-ad56-d3c4bf7b16c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1586915860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6ab833-2825-4421-9535-486a4e818bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9c790ba3a94c3bb2c90d13bad3c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:07Z,use_quota=True,user_id='f6f9258021b9442f8fefe575b2f9ac7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf4509a-6020-4048-99c0-05b5d25f56bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf4509a-6020-4048-99c0-05b5d25f56bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977af0d9-a932-4335-90ab-0a1521177367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977af0d9-a932-4335-90ab-0a1521177367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6ab833-2825-4421-9535-486a4e818bcd', 'volume_name': 'volume-7c6ab833-2825-4421-9535-486a4e818bcd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3ad79c-0383-492f-990c-e61e88a31f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3ad79c-0383-492f-990c-e61e88a31f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479b00d7-da5e-4648-9c6e-b6ca0ee3ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Volume 7c6ab833-2825-4421-9535-486a4e818bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6ab833-2825-4421-9535-486a4e818bcd', 'volume_size': 1} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1586915860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6ab833-2825-4421-9535-486a4e818bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9c790ba3a94c3bb2c90d13bad3c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:07Z,use_quota=True,user_id='f6f9258021b9442f8fefe575b2f9ac7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Creating volume 7c6ab833-2825-4421-9535-486a4e818bcd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:07 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd 1073741824 Sep 28 12:25:07 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:07 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a Sep 28 12:25:07 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:08 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd 1073741824" returned: 0 in 0.497s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:08 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a" returned: 0 in 0.623s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:08 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef Sep 28 12:25:08 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:08 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd Sep 28 12:25:08 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:08 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479b00d7-da5e-4648-9c6e-b6ca0ee3ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6ab833-2825-4421-9535-486a4e818bcd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123b2cf2-7d37-4491-85f5-dae3292a464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Volume volume-7c6ab833-2825-4421-9535-486a4e818bcd (7c6ab833-2825-4421-9535-486a4e818bcd): created successfully Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123b2cf2-7d37-4491-85f5-dae3292a464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Flow 'volume_create_manager' (d1dc1f0d-2bc7-4e94-8766-72c06cfb08e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3546cb8b-d9c5-4241-92cf-b65123a34bd4 tempest-VolumesListAdminTestJSON-1956453614 None] Created volume successfully. Sep 28 12:25:08 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef" returned: 0 in 0.426s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:08 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef Sep 28 12:25:08 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:08 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a.2cf8ee5a-0b04-47b8-b73c-69789249dbef" returned: 0 in 0.268s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-2cf8ee5a-0b04-47b8-b73c-69789249dbef" released by "_delete_snapshot" :: held 1.931s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-69199104-83ce-44b8-950d-6941725f982a" released by "delete_snapshot" :: held 1.965s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Created reservations ['62f6fe6b-b52c-4fed-81c9-4fbe28a48134', 'd169be50-6588-45a7-8c78-af1472e8346d', '375ae782-8407-4a1b-8643-a4141c873798', 'af1768c3-0635-414b-826d-7494ed280581'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:08 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Flow 'volume_create_manager' (6badd102-99d0-472d-bb66-dac7083e2d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e616b82c-fc70-47f5-9023-3f008b6c1460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e616b82c-fc70-47f5-9023-3f008b6c1460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-442544822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0eff7e4-0281-4ce7-8b0b-481db71b7aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256644b9272240068ff79ef1d8c06369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:09Z,use_quota=True,user_id='22aae50c50034addaccab0fd3e1b4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8380b83d-ef82-4233-9339-d6b547bd9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8380b83d-ef82-4233-9339-d6b547bd9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0d7e89-113e-4d08-b2c6-79781f614d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0d7e89-113e-4d08-b2c6-79781f614d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0eff7e4-0281-4ce7-8b0b-481db71b7aeb', 'volume_name': 'volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14cf038-ddd6-48d1-b3a5-73d629316db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14cf038-ddd6-48d1-b3a5-73d629316db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985d0940-26b4-4716-9d9f-215936872607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Volume b0eff7e4-0281-4ce7-8b0b-481db71b7aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb', 'volume_size': 1} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-442544822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0eff7e4-0281-4ce7-8b0b-481db71b7aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='256644b9272240068ff79ef1d8c06369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:09Z,use_quota=True,user_id='22aae50c50034addaccab0fd3e1b4abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Creating volume b0eff7e4-0281-4ce7-8b0b-481db71b7aeb {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:09 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:09 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb 1073741824 Sep 28 12:25:09 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Delete snapshot completed successfully. Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e7116bb7-f198-472f-8400-b2334fc9721e tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-2cf8ee5a-0b04-47b8-b73c-69789249dbef-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:09 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb 1073741824" returned: 0 in 0.494s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:09 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb Sep 28 12:25:09 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:09 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985d0940-26b4-4716-9d9f-215936872607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13685904-3889-4723-8633-98e504db2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:10 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Volume volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb (b0eff7e4-0281-4ce7-8b0b-481db71b7aeb): created successfully Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13685904-3889-4723-8633-98e504db2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Flow 'volume_create_manager' (6badd102-99d0-472d-bb66-dac7083e2d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5496e925-cb60-4509-bfa1-056491c1c902 tempest-CinderUnicodeTest-448231503 None] Created volume successfully. Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-69199104-83ce-44b8-950d-6941725f982a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-69199104-83ce-44b8-950d-6941725f982a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Flow 'volume_create_manager' (9bcdf4e5-33a6-4630-9ef6-753dce06745a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2338fe-bebe-4e04-9d63-887edfe9e14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2338fe-bebe-4e04-9d63-887edfe9e14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-16586950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695f0ccd-ab03-452e-b551-c255c85196c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9c790ba3a94c3bb2c90d13bad3c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:10Z,use_quota=True,user_id='f6f9258021b9442f8fefe575b2f9ac7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c777c596-0490-4239-9b8f-c57c47e4ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c777c596-0490-4239-9b8f-c57c47e4ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ae5e58-a346-4ab2-8ae1-5470759f5392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ae5e58-a346-4ab2-8ae1-5470759f5392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695f0ccd-ab03-452e-b551-c255c85196c6', 'volume_name': 'volume-695f0ccd-ab03-452e-b551-c255c85196c6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8274020b-3836-40fa-bd8f-792b9ced09dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8274020b-3836-40fa-bd8f-792b9ced09dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd0e3a0-e134-4088-8487-8c305c13f30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:10 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Volume 695f0ccd-ab03-452e-b551-c255c85196c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695f0ccd-ab03-452e-b551-c255c85196c6', 'volume_size': 1} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-16586950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=695f0ccd-ab03-452e-b551-c255c85196c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9c790ba3a94c3bb2c90d13bad3c059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:10Z,use_quota=True,user_id='f6f9258021b9442f8fefe575b2f9ac7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Creating volume 695f0ccd-ab03-452e-b551-c255c85196c6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:10 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:10 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 1073741824 Sep 28 12:25:10 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-69199104-83ce-44b8-950d-6941725f982a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-69199104-83ce-44b8-950d-6941725f982a" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4550f76d-e494-4098-8797-4ed91c1afa58]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:10 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a Sep 28 12:25:10 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:10 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 1073741824" returned: 0 in 0.464s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:10 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a" returned: 0 in 0.414s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:10 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 Sep 28 12:25:10 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:10 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a Sep 28 12:25:10 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:11 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:11 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-69199104-83ce-44b8-950d-6941725f982a" returned: 0 in 0.284s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd0e3a0-e134-4088-8487-8c305c13f30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695f0ccd-ab03-452e-b551-c255c85196c6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aca3a9-480b-4205-8765-8113d0ecfe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-69199104-83ce-44b8-950d-6941725f982a" released by "delete_volume" :: held 0.791s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Volume volume-695f0ccd-ab03-452e-b551-c255c85196c6 (695f0ccd-ab03-452e-b551-c255c85196c6): created successfully Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aca3a9-480b-4205-8765-8113d0ecfe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Flow 'volume_create_manager' (9bcdf4e5-33a6-4630-9ef6-753dce06745a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-be6ada97-ea9b-4d24-83b1-94e37872314f tempest-VolumesListAdminTestJSON-1956453614 None] Created volume successfully. Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Created reservations ['9cbbd9f7-ab46-44ca-9a56-cdfa11b45de6', '6df60529-3e0c-4a99-92ea-5ce1691e7de1', 'd4f4dc76-6f5c-471e-95d3-f32f4898e600', '4f5cec5e-b0be-4d9d-904b-6b3a160bb1c8'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:11 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:11 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Creating offline snapshot e4eb2dbd-076e-479b-8505-12a9b9fa5b90 of volume b0eff7e4-0281-4ce7-8b0b-481db71b7aeb {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[556f3b11-9543-4103-b6f4-be76423bab14]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-ccbbe06b-536d-489c-ab09-6aa7828b9fcd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-ccbbe06b-536d-489c-ab09-6aa7828b9fcd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "cinder-quobyte-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:11 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb Sep 28 12:25:11 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9768d-19d1-488c-b7d3-df7f9e15ab1c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:11 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.290s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Deleted volume successfully. Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-2cc1e493-57cf-4ae8-aac2-5e971fd82c5f tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-69199104-83ce-44b8-950d-6941725f982a-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:11 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd Sep 28 12:25:11 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:11 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" returned: 0 in 0.469s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:11 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 1G Sep 28 12:25:11 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:12 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" returned: 0 in 0.430s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:12 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd Sep 28 12:25:12 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:12 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" returned: 0 in 0.300s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:12 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 1G" returned: 0 in 0.485s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-quobyte-ccbbe06b-536d-489c-ab09-6aa7828b9fcd" released by "delete_volume" :: held 0.824s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:12 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 Sep 28 12:25:12 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Created reservations ['b63a8da3-9f44-475d-a8f6-c7360cb98598', '293058f5-3b47-4b20-990a-31a5328f4f8d', 'a3575204-03d9-4d8b-9cbf-47a9610c1c98', '38ffcadf-4551-4429-bf61-5cff0467ce5a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:12 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:12 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:12 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90" returned: 0 in 0.397s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:12 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 is being set with open permissions: ugo+rw Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:12 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 Sep 28 12:25:12 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:12 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.332s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Deleted volume successfully. Sep 28 12:25:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a356be92-0417-45d9-a877-e6d661e86025 tempest-VolumesSnapshotTestJSON-381674265 None] Lock "cinder-ccbbe06b-536d-489c-ab09-6aa7828b9fcd-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:13 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90" returned: 0 in 0.337s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Flow 'volume_create_manager' (a40a5aae-c80a-418e-aa95-a9e7be936ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71ce2e-f82a-42d2-b46c-c7bc8cd5c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71ce2e-f82a-42d2-b46c-c7bc8cd5c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a4a8a6-cf8b-412c-84a4-a80173b6e410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7e497a2b3e44f085af10bb53ce5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:13Z,use_quota=True,user_id='8d3fa07dffb64d4eb23023927c2b1f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be95c6da-f4e0-40c1-8ede-3554fcbb55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be95c6da-f4e0-40c1-8ede-3554fcbb55d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e293afc3-7b45-4353-93be-54c81bb41275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e293afc3-7b45-4353-93be-54c81bb41275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49a4a8a6-cf8b-412c-84a4-a80173b6e410', 'volume_name': 'volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569860ee-1f34-4274-a612-e029fd628e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569860ee-1f34-4274-a612-e029fd628e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2de687-4698-4be4-b101-37234e104bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Volume 49a4a8a6-cf8b-412c-84a4-a80173b6e410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410', 'volume_size': 1} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:13 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.info Sep 28 12:25:13 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:13 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.info" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:13 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.info is being set with open permissions: ugo+rw Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:13 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.info Sep 28 12:25:13 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:13 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.info" returned: 0 in 0.266s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a4a8a6-cf8b-412c-84a4-a80173b6e410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a7e497a2b3e44f085af10bb53ce5128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:13Z,use_quota=True,user_id='8d3fa07dffb64d4eb23023927c2b1f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Creating volume 49a4a8a6-cf8b-412c-84a4-a80173b6e410 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:13 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:13 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 1073741824 Sep 28 12:25:13 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6f33c6ce-2f95-48cf-9395-23e6935a7206 tempest-CinderUnicodeTest-448231503 None] Create snapshot completed successfully Sep 28 12:25:14 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 1073741824" returned: 0 in 0.522s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:14 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 Sep 28 12:25:14 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Acquiring lock "cinder-e4eb2dbd-076e-479b-8505-12a9b9fa5b90-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Lock "cinder-e4eb2dbd-076e-479b-8505-12a9b9fa5b90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Acquiring lock "cinder-quobyte-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Lock "cinder-quobyte-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Acquiring lock "cinder-quobyte-e4eb2dbd-076e-479b-8505-12a9b9fa5b90" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Lock "cinder-quobyte-e4eb2dbd-076e-479b-8505-12a9b9fa5b90" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Deleting offline snapshot e4eb2dbd-076e-479b-8505-12a9b9fa5b90 of volume b0eff7e4-0281-4ce7-8b0b-481db71b7aeb {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] snapshot_file for this snap is: volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ead4e72-94f6-4f42-8532-a7a710d3ab26]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:14 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410" returned: 0 in 0.373s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:14 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 Sep 28 12:25:14 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2de687-4698-4be4-b101-37234e104bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f279cf-5c1c-49f7-bfaf-ecafbd3c58c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Volume volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 (49a4a8a6-cf8b-412c-84a4-a80173b6e410): created successfully Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f279cf-5c1c-49f7-bfaf-ecafbd3c58c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Flow 'volume_create_manager' (a40a5aae-c80a-418e-aa95-a9e7be936ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f7c32ab4-fda3-4433-bdae-8e50321c61dc tempest-VolumesListAdminTestJSON-505589062 None] Created volume successfully. Sep 28 12:25:15 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90" returned: 0 in 0.458s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[33754c3e-69ee-4e60-b7b3-b0d8cab18529]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:15 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb Sep 28 12:25:15 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Acquiring lock "cinder-49a4a8a6-cf8b-412c-84a4-a80173b6e410-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Lock "cinder-49a4a8a6-cf8b-412c-84a4-a80173b6e410-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Acquiring lock "cinder-quobyte-49a4a8a6-cf8b-412c-84a4-a80173b6e410" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Lock "cinder-quobyte-49a4a8a6-cf8b-412c-84a4-a80173b6e410" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "cinder-695f0ccd-ab03-452e-b551-c255c85196c6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5d25ba-ca24-43c7-bf3b-2fb4c5964db6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-695f0ccd-ab03-452e-b551-c255c85196c6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "cinder-quobyte-695f0ccd-ab03-452e-b551-c255c85196c6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-quobyte-695f0ccd-ab03-452e-b551-c255c85196c6" acquired by "delete_volume" :: waited 0.042s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce876764-57a8-4304-9c41-bcab27cae992]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:15 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 Sep 28 12:25:15 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:15 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" returned: 0 in 0.561s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:15 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 Sep 28 12:25:15 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:15 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 Sep 28 12:25:15 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:15 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410" returned: 0 in 0.494s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:16 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410 Sep 28 12:25:16 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:16 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:16 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6" returned: 0 in 0.454s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90" returned: 0 in 0.409s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:16 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6 Sep 28 12:25:16 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:16 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90 Sep 28 12:25:16 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:16 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-49a4a8a6-cf8b-412c-84a4-a80173b6e410" returned: 0 in 0.295s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Lock "cinder-quobyte-49a4a8a6-cf8b-412c-84a4-a80173b6e410" released by "delete_volume" :: held 0.856s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Created reservations ['c1f88687-8a88-4537-98da-983b9eb0164f', '9d2fd21a-a1a6-4f40-b951-49c73054b01c', '2d6aaac9-8880-4f84-ab55-8e0291596cae', '46aab130-d923-48bf-a9af-3f5158c03b8a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:16 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-695f0ccd-ab03-452e-b551-c255c85196c6" returned: 0 in 0.281s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-quobyte-695f0ccd-ab03-452e-b551-c255c85196c6" released by "delete_volume" :: held 0.806s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:16 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb.e4eb2dbd-076e-479b-8505-12a9b9fa5b90" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:16 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:16 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Lock "cinder-quobyte-e4eb2dbd-076e-479b-8505-12a9b9fa5b90" released by "_delete_snapshot" :: held 1.952s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Lock "cinder-quobyte-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" released by "delete_snapshot" :: held 1.988s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Created reservations ['dbbf3f43-fff0-484f-8451-81d91728bded', '0fc7f0d3-fa4d-4c67-8f3b-491e74473a05', '3035b414-e32b-4a20-ada0-9468c86f5fe2', 'e6d9413a-7826-4906-865d-e47e28cc2304'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Created reservations ['db04d9ae-3a53-40ad-8372-2095bf9773dc', 'c723b59c-e47b-4645-88ee-858da8779d5b', '4b4d570c-d5fa-4534-beed-729cf811a24b', '91773eee-804b-4810-bce3-d52aafd460a5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:16 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:16 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Delete snapshot completed successfully. Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6abfedfe-61ca-4305-a7d9-89fa39a96c1c tempest-CinderUnicodeTest-448231503 None] Lock "cinder-e4eb2dbd-076e-479b-8505-12a9b9fa5b90-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:16 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.487s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Deleted volume successfully. Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bda8b7cc-82c7-4514-9391-2025a7b18918 tempest-VolumesListAdminTestJSON-505589062 None] Lock "cinder-49a4a8a6-cf8b-412c-84a4-a80173b6e410-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:17 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Deleted volume successfully. Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d80e2d61-c467-4a18-a029-161ffc633058 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-695f0ccd-ab03-452e-b551-c255c85196c6-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "cinder-7c6ab833-2825-4421-9535-486a4e818bcd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-7c6ab833-2825-4421-9535-486a4e818bcd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "cinder-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "cinder-quobyte-7c6ab833-2825-4421-9535-486a4e818bcd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Lock "cinder-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-quobyte-7c6ab833-2825-4421-9535-486a4e818bcd" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0e20b8-aa0e-4d23-b7ae-7905b61cf3e2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "cinder-quobyte-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Lock "cinder-quobyte-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b9232-eece-4fce-89b2-e97405cb3d0d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:18 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd Sep 28 12:25:18 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:18 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb Sep 28 12:25:18 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:18 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd" returned: 0 in 0.432s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:18 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd Sep 28 12:25:18 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:18 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" returned: 0 in 0.439s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:18 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb Sep 28 12:25:18 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:18 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-7c6ab833-2825-4421-9535-486a4e818bcd" returned: 0 in 0.292s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-quobyte-7c6ab833-2825-4421-9535-486a4e818bcd" released by "delete_volume" :: held 0.814s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Created reservations ['e9a61508-3d32-4453-8bdf-cd74c5926c6c', 'a44986e4-dbcf-4a7d-8359-5dd94eeaac54', '93957398-1e1f-449d-a3eb-7988115dbb1a', '74dd7650-07ac-49d0-99bc-6f664024bbf9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:18 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" returned: 0 in 0.330s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Lock "cinder-quobyte-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb" released by "delete_volume" :: held 0.849s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:18 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:18 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Created reservations ['d785b40b-c249-4ad8-b17d-dcace9f9ede9', 'ca042638-f3d9-4560-97b8-c38838e55975', 'f8890773-7958-4d81-a847-c2c1c18e34d3', 'f70d8bf3-778b-4f41-bc9e-8f716cd5fd0c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "cinder-fa9db09f-bf43-499d-915b-c6f9a5d2964d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:19 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:19 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-fa9db09f-bf43-499d-915b-c6f9a5d2964d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "cinder-quobyte-fa9db09f-bf43-499d-915b-c6f9a5d2964d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-quobyte-fa9db09f-bf43-499d-915b-c6f9a5d2964d" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff955d8-cda1-466f-865c-6a253ecdf561]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:19 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.416s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Deleted volume successfully. Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e98a09-2fde-4605-808c-0c9a2c072222 tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-7c6ab833-2825-4421-9535-486a4e818bcd-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:19 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d Sep 28 12:25:19 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:19 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.356s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Deleted volume successfully. Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-25c6be60-cd2b-4961-8565-8b88ee0c8e34 tempest-CinderUnicodeTest-448231503 None] Lock "cinder-b0eff7e4-0281-4ce7-8b0b-481db71b7aeb-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:19 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d" returned: 0 in 0.385s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:19 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d Sep 28 12:25:19 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:19 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fa9db09f-bf43-499d-915b-c6f9a5d2964d" returned: 0 in 0.279s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-quobyte-fa9db09f-bf43-499d-915b-c6f9a5d2964d" released by "delete_volume" :: held 0.728s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Created reservations ['ca8bf9f4-bf1c-4bd2-8b54-d649aba967fd', '98c402a7-e446-4f9f-9bae-5f94c45a784d', '226e0d0d-cbb1-41d2-a095-2e6639bfdd63', '6e9242de-ee5f-4b08-abb7-87e06bddb9be'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "cinder-aaac3560-fbeb-4595-95a1-799307146ea1-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:20 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:20 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Lock "cinder-aaac3560-fbeb-4595-95a1-799307146ea1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "cinder-quobyte-aaac3560-fbeb-4595-95a1-799307146ea1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Lock "cinder-quobyte-aaac3560-fbeb-4595-95a1-799307146ea1" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f96ab6-d506-4465-8a51-8cb0b53d2088]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:20 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 Sep 28 12:25:20 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:20 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Deleted volume successfully. Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b4d04849-d777-4e88-8feb-8914ebe2983b tempest-VolumesListAdminTestJSON-1956453614 None] Lock "cinder-fa9db09f-bf43-499d-915b-c6f9a5d2964d-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:20 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1" returned: 0 in 0.495s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:20 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1 Sep 28 12:25:20 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:21 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-aaac3560-fbeb-4595-95a1-799307146ea1" returned: 0 in 0.323s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Lock "cinder-quobyte-aaac3560-fbeb-4595-95a1-799307146ea1" released by "delete_volume" :: held 0.888s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Created reservations ['ab838a51-ebae-4f2c-a108-2faed0d00645', 'bc0a540f-5d8f-4845-b45d-49657a7f0a5b', 'a599daa1-7487-4afc-af60-ac869627d136', 'cb947d3d-5b0b-47a8-8232-8ce86ac6da58'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:21 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:21 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:21 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.297s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Deleted volume successfully. Sep 28 12:25:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-012daeb3-d2a2-4f30-8bed-28b62f0291e0 tempest-CinderUnicodeTest-448231503 None] Lock "cinder-aaac3560-fbeb-4595-95a1-799307146ea1-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Flow 'volume_create_manager' (d351bd4b-cc0e-4341-81df-b64662c8a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b2ed0b-f684-43d7-a4e1-1c0af37b0a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b2ed0b-f684-43d7-a4e1-1c0af37b0a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062706351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b03538b34384717a858144bd7f2920c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:26Z,use_quota=True,user_id='6bbfb2b0639845c7b07ec195e2896fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeefa567-3a32-45e0-96f4-967326a6d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeefa567-3a32-45e0-96f4-967326a6d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a52e2e-0aa8-48dd-a280-30ac01b9ac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a52e2e-0aa8-48dd-a280-30ac01b9ac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0bcf585-6b26-4ca8-8c87-9a7e60b4ab51', 'volume_name': 'volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad63253-63c5-4001-a2fb-1641eff2d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad63253-63c5-4001-a2fb-1641eff2d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb440c6-29aa-4ff6-bef6-bf6ffb4ab939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:26 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Volume d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51', 'volume_size': 1} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062706351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b03538b34384717a858144bd7f2920c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:26Z,use_quota=True,user_id='6bbfb2b0639845c7b07ec195e2896fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Creating volume d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:26 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:26 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 1073741824 Sep 28 12:25:26 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Flow 'volume_create_manager' (1bfd9ed8-3f8d-4115-94ff-566e8de33f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7665b33-b611-410b-894a-684a76716339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7665b33-b611-410b-894a-684a76716339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef4c28c-8704-49c2-893d-188dca125095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49952dee06b453684759ed935b767e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:26Z,use_quota=True,user_id='0b753e3d467341118cc3907ee8f789d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cd6165-3d3d-40e4-a997-48b82c6293cc),volume_type_id=00cd6165-3d3d-40e4-a997-48b82c6293cc)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fed132-adb2-49f8-9853-acbb9a96042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fed132-adb2-49f8-9853-acbb9a96042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b64fc0-d136-44e2-b1a1-f31a47e9c219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:26 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b64fc0-d136-44e2-b1a1-f31a47e9c219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ef4c28c-8704-49c2-893d-188dca125095', 'volume_name': 'volume-6ef4c28c-8704-49c2-893d-188dca125095', 'volume_size': 1, 'image_id': 'd8888b45-059e-45c7-ad70-4f8430560cae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8888b45-059e-45c7-ad70-4f8430560cae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '760f7a9c40e1c98e6ae224a6ce35c0b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b49952dee06b453684759ed935b767e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc743254145517e6959d29191c153fd270f2e8d744d1de3892c48ead58260fa991dcdf69a5a0ebefb98ce036cbae027060ecd9fa5e410ba0cbeb32b90f4de710', 'id': 'd8888b45-059e-45c7-ad70-4f8430560cae', 'created_at': datetime.datetime(2026, 9, 28, 10, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8888b45-059e-45c7-ad70-4f8430560cae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d9deb2-4095-4486-bfc6-a9e403f7d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d9deb2-4095-4486-bfc6-a9e403f7d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:27 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbaf76f-12cb-4b4e-9aaa-f5df864ca311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:27 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Volume 6ef4c28c-8704-49c2-893d-188dca125095: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ef4c28c-8704-49c2-893d-188dca125095', 'volume_size': 1, 'image_id': 'd8888b45-059e-45c7-ad70-4f8430560cae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8888b45-059e-45c7-ad70-4f8430560cae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '760f7a9c40e1c98e6ae224a6ce35c0b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b49952dee06b453684759ed935b767e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc743254145517e6959d29191c153fd270f2e8d744d1de3892c48ead58260fa991dcdf69a5a0ebefb98ce036cbae027060ecd9fa5e410ba0cbeb32b90f4de710', 'id': 'd8888b45-059e-45c7-ad70-4f8430560cae', 'created_at': datetime.datetime(2026, 9, 28, 10, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8888b45-059e-45c7-ad70-4f8430560cae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Trying to clone 6ef4c28c-8704-49c2-893d-188dca125095 from image d8888b45-059e-45c7-ad70-4f8430560cae at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8888b45-059e-45c7-ad70-4f8430560cae', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 1073741824" returned: 0 in 0.568s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:27 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 Sep 28 12:25:27 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:25:27 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d3e8d9-a872-4091-8044-fa89b3ebbd75]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:27 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD Sep 28 12:25:27 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:27 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51" returned: 0 in 0.294s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb440c6-29aa-4ff6-bef6-bf6ffb4ab939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9d9007-ce1a-4008-80d2-b1aceb512447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:27 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Volume volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 (d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51): created successfully Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9d9007-ce1a-4008-80d2-b1aceb512447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Flow 'volume_create_manager' (d351bd4b-cc0e-4341-81df-b64662c8a323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-00f9fec4-5288-47c7-93e8-048bab9e3169 tempest-ProjectReaderTests-283779640 None] Created volume successfully. Sep 28 12:25:27 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:27 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD Sep 28 12:25:27 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:28 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Temporary image d8888b45-059e-45c7-ad70-4f8430560cae is fetched for user 0b753e3d467341118cc3907ee8f789d0. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[706b5421-ecee-4b02-b839-a5f91e438768]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:28 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD Sep 28 12:25:28 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:28 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:28 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD Sep 28 12:25:28 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Acquiring lock "cinder-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Lock "cinder-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Acquiring lock "cinder-quobyte-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Lock "cinder-quobyte-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[247cad0b-f788-46f7-b197-9012762f9b09]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:28 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 Sep 28 12:25:28 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:28 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef4c28c-8704-49c2-893d-188dca125095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b49952dee06b453684759ed935b767e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:26Z,use_quota=True,user_id='0b753e3d467341118cc3907ee8f789d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cd6165-3d3d-40e4-a997-48b82c6293cc),volume_type_id=00cd6165-3d3d-40e4-a997-48b82c6293cc)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Creating volume 6ef4c28c-8704-49c2-893d-188dca125095 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:28 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:28 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 1073741824 Sep 28 12:25:28 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:29 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51" returned: 0 in 0.458s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:29 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51 Sep 28 12:25:29 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:29 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 1073741824" returned: 0 in 0.530s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:29 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51" returned: 0 in 0.303s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:29 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 Sep 28 12:25:29 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Lock "cinder-quobyte-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51" released by "delete_volume" :: held 0.818s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Created reservations ['1f12a332-464a-40c0-80bb-e297fb6fbe17', '81affd67-05b0-477e-aa2c-991696b0618a', 'cc389c6d-fb32-413a-9c6d-a2a4e09390f9', '0bd76cb7-1cbb-4092-971e-06a5d04eaaf5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:29 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:29 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:29 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095" returned: 0 in 0.338s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Attempting download of d8888b45-059e-45c7-ad70-4f8430560cae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8888b45-059e-45c7-ad70-4f8430560cae', 'metadata': {}}])) to volume 6ef4c28c-8704-49c2-893d-188dca125095. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d73537b-68b5-47ee-bee2-1a125e368f13]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8888b45-059e-45c7-ad70-4f8430560cae_7fim5szx {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:30 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.312s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:30 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Deleted volume successfully. Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-886bc2bc-e56e-4575-b117-c25801e7d967 tempest-ProjectReaderTests-283779640 None] Lock "cinder-d0bcf585-6b26-4ca8-8c87-9a7e60b4ab51-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:30 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8888b45-059e-45c7-ad70-4f8430560cae_7fim5szx Sep 28 12:25:30 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:30 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8888b45-059e-45c7-ad70-4f8430560cae_7fim5szx" returned: 0 in 0.392s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8888b45-059e-45c7-ad70-4f8430560cae_7fim5szx {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Flow 'volume_create_manager' (07d1365f-6d24-461d-ae9e-53c16cbf29e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8c3a99-8421-4049-8960-8574850864ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8c3a99-8421-4049-8960-8574850864ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205142079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597c26a9-658f-4a1b-b493-fdc542e16764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b03538b34384717a858144bd7f2920c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:30Z,use_quota=True,user_id='6bbfb2b0639845c7b07ec195e2896fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e446f5-ba74-47ce-94ba-7a4e56349a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:30 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8888b45-059e-45c7-ad70-4f8430560cae_7fim5szx Sep 28 12:25:30 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e446f5-ba74-47ce-94ba-7a4e56349a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcc89b6-91b9-4bd3-a5a5-b4c8ea93ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcc89b6-91b9-4bd3-a5a5-b4c8ea93ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597c26a9-658f-4a1b-b493-fdc542e16764', 'volume_name': 'volume-597c26a9-658f-4a1b-b493-fdc542e16764', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebdb9cc-592f-4d7a-9b5e-84e011579767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebdb9cc-592f-4d7a-9b5e-84e011579767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755ba6d2-a9a5-4536-be53-775c6018f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:30 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Volume 597c26a9-658f-4a1b-b493-fdc542e16764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597c26a9-658f-4a1b-b493-fdc542e16764', 'volume_size': 1} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205142079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597c26a9-658f-4a1b-b493-fdc542e16764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b03538b34384717a858144bd7f2920c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:30Z,use_quota=True,user_id='6bbfb2b0639845c7b07ec195e2896fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Creating volume 597c26a9-658f-4a1b-b493-fdc542e16764 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:30 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:30 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 1073741824 Sep 28 12:25:30 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:30 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8888b45-059e-45c7-ad70-4f8430560cae_7fim5szx" returned: 1 in 0.378s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8888b45-059e-45c7-ad70-4f8430560cae_7fim5szx' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a19485-8f22-48dd-ad43-5b547dfc950d]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:30 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD Sep 28 12:25:30 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:31 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 1073741824" returned: 0 in 0.510s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:31 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:31 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:31 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:31 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD Sep 28 12:25:31 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:31 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764" returned: 0 in 0.320s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755ba6d2-a9a5-4536-be53-775c6018f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597c26a9-658f-4a1b-b493-fdc542e16764', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbad6709-382c-40a0-af51-fc4d7f575073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:31 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] d8888b45-059e-45c7-ad70-4f8430560cae was raw, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Volume volume-597c26a9-658f-4a1b-b493-fdc542e16764 (597c26a9-658f-4a1b-b493-fdc542e16764): created successfully Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbad6709-382c-40a0-af51-fc4d7f575073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:31 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 Sep 28 12:25:31 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Flow 'volume_create_manager' (07d1365f-6d24-461d-ae9e-53c16cbf29e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-53be2a54-5be0-47d3-8c4b-89b69b4e3d09 tempest-ProjectReaderTests-283779640 None] Created volume successfully. Sep 28 12:25:31 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095" returned: 0 in 0.497s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8888b45-059e-45c7-ad70-4f8430560cae_ovc1afzedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:25:31 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:25:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:32 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 1G Sep 28 12:25:32 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Flow 'volume_create_manager' (01fc13e6-81d5-422a-8246-7e38f2dd2996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1800db-864a-4db3-9b8a-ac69d021d118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1800db-864a-4db3-9b8a-ac69d021d118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1870941166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30336c03-d956-4fa0-b6e3-b44e2ecd25e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c503f7cb14245f7bdd6e05dec63715e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:32Z,use_quota=True,user_id='17be7f9f2bb84848b60d61db3d206e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3e3844-cc02-490c-a717-ab51303643a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:32 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3e3844-cc02-490c-a717-ab51303643a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedb9233-9cee-4dcb-b457-a06e20c0054a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bedb9233-9cee-4dcb-b457-a06e20c0054a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30336c03-d956-4fa0-b6e3-b44e2ecd25e9', 'volume_name': 'volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffa5622-0caf-4ced-9cbf-d23e95bf44f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffa5622-0caf-4ced-9cbf-d23e95bf44f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281b9663-b292-4d05-88c4-0bc475fe80bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Volume 30336c03-d956-4fa0-b6e3-b44e2ecd25e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9', 'volume_size': 1} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1870941166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30336c03-d956-4fa0-b6e3-b44e2ecd25e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c503f7cb14245f7bdd6e05dec63715e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:32Z,use_quota=True,user_id='17be7f9f2bb84848b60d61db3d206e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Creating volume 30336c03-d956-4fa0-b6e3-b44e2ecd25e9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:32 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 1G" returned: 0 in 0.438s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Downloaded image d8888b45-059e-45c7-ad70-4f8430560cae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8888b45-059e-45c7-ad70-4f8430560cae', 'metadata': {}}])) to volume 6ef4c28c-8704-49c2-893d-188dca125095 successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Temporary image d8888b45-059e-45c7-ad70-4f8430560cae for user 0b753e3d467341118cc3907ee8f789d0 is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Marking volume 6ef4c28c-8704-49c2-893d-188dca125095 as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Copying metadata from image d8888b45-059e-45c7-ad70-4f8430560cae to 6ef4c28c-8704-49c2-893d-188dca125095. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Creating volume glance metadata for volume 6ef4c28c-8704-49c2-893d-188dca125095 backed by image d8888b45-059e-45c7-ad70-4f8430560cae with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd8888b45-059e-45c7-ad70-4f8430560cae', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '760f7a9c40e1c98e6ae224a6ce35c0b3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:25:32 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 1073741824 Sep 28 12:25:32 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbaf76f-12cb-4b4e-9aaa-f5df864ca311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef4c28c-8704-49c2-893d-188dca125095', 'volume_size': 1, 'image_id': 'd8888b45-059e-45c7-ad70-4f8430560cae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8888b45-059e-45c7-ad70-4f8430560cae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '760f7a9c40e1c98e6ae224a6ce35c0b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b49952dee06b453684759ed935b767e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bc743254145517e6959d29191c153fd270f2e8d744d1de3892c48ead58260fa991dcdf69a5a0ebefb98ce036cbae027060ecd9fa5e410ba0cbeb32b90f4de710', 'id': 'd8888b45-059e-45c7-ad70-4f8430560cae', 'created_at': datetime.datetime(2026, 9, 28, 10, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8888b45-059e-45c7-ad70-4f8430560cae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2074b3a-ed49-4392-8fa2-fa858987b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:32 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Volume volume-6ef4c28c-8704-49c2-893d-188dca125095 (6ef4c28c-8704-49c2-893d-188dca125095): created successfully Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2074b3a-ed49-4392-8fa2-fa858987b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Flow 'volume_create_manager' (1bfd9ed8-3f8d-4115-94ff-566e8de33f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Acquiring lock "cinder-597c26a9-658f-4a1b-b493-fdc542e16764-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c2017543-9c66-425b-b8ea-b048bd5bd5c9 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Created volume successfully. Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Lock "cinder-597c26a9-658f-4a1b-b493-fdc542e16764-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Acquiring lock "cinder-quobyte-597c26a9-658f-4a1b-b493-fdc542e16764" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Lock "cinder-quobyte-597c26a9-658f-4a1b-b493-fdc542e16764" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a08a1-3267-42f0-903a-c8504fe9826d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Acquiring lock "cinder-6ef4c28c-8704-49c2-893d-188dca125095-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "cinder-6ef4c28c-8704-49c2-893d-188dca125095-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:32 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 Sep 28 12:25:32 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Acquiring lock "cinder-quobyte-6ef4c28c-8704-49c2-893d-188dca125095" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "cinder-quobyte-6ef4c28c-8704-49c2-893d-188dca125095" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6572332-db8b-49af-be25-8b6599bcb2dc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:32 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 1073741824" returned: 0 in 0.586s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:33 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 Sep 28 12:25:33 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:33 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 Sep 28 12:25:33 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:33 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764" returned: 0 in 0.506s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:33 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764 Sep 28 12:25:33 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:33 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (281b9663-b292-4d05-88c4-0bc475fe80bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7083e11-26df-40ae-9b03-16a314df2b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:33 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095" returned: 0 in 0.416s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Volume volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 (30336c03-d956-4fa0-b6e3-b44e2ecd25e9): created successfully Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7083e11-26df-40ae-9b03-16a314df2b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Flow 'volume_create_manager' (01fc13e6-81d5-422a-8246-7e38f2dd2996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:33 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095 Sep 28 12:25:33 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-320fe222-9c1c-492e-9d84-8411890810a2 tempest-VolumesTransfersV357Test-1822211939 None] Created volume successfully. Sep 28 12:25:33 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-597c26a9-658f-4a1b-b493-fdc542e16764" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Lock "cinder-quobyte-597c26a9-658f-4a1b-b493-fdc542e16764" released by "delete_volume" :: held 0.882s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=206,cinder:SELECT=153,cinder:INSERT=58,cinder:DELETE=21 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Created reservations ['e2f3f8db-a564-4d83-9592-1d63933b3316', '97cf7376-8247-4939-abd4-971c3ca11634', '29badb06-8811-4d4b-ab60-5167a09ce11e', '1c4d7ec7-414b-4918-95f9-88f5af1c0518'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:33 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ef4c28c-8704-49c2-893d-188dca125095" returned: 0 in 0.276s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "cinder-quobyte-6ef4c28c-8704-49c2-893d-188dca125095" released by "delete_volume" :: held 0.750s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:33 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:33 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:33 devstack cinder-volume[87167]: WARNING cinder.quota [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:25:33 devstack cinder-volume[87167]: WARNING cinder.quota [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Created reservations ['e745fd30-169c-41c7-a245-f6af22b8f634', '7e2bf91b-f5e5-4307-8ab8-edb85db9a704', 'b0fc48a2-32ab-4c3a-a5fa-bbf5984b1ff8', '00514015-4397-4fa8-ae1b-5f06cd610d29'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:33 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:33 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:34 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.312s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:34 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Deleted volume successfully. Sep 28 12:25:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-552dcbb9-106b-4000-b170-af6a28650b5a tempest-ProjectReaderTests-283779640 None] Lock "cinder-597c26a9-658f-4a1b-b493-fdc542e16764-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:34 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.320s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:34 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Deleted volume successfully. Sep 28 12:25:34 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=181,cinder:INSERT=71,cinder:UPDATE=254,cinder:DELETE=16 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:25:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-275f4b11-ebfb-4792-8da0-28fa53b70a67 tempest-VolumeAndVolumeTypeFromImageTest-110684908 None] Lock "cinder-6ef4c28c-8704-49c2-893d-188dca125095-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e53fb6b1-3327-4365-9e73-fdd6256b85a3 tempest-VolumesTransfersV357Test-1960532758 None] Transfer volume completed successfully. Sep 28 12:25:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Acquiring lock "cinder-30336c03-d956-4fa0-b6e3-b44e2ecd25e9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Lock "cinder-30336c03-d956-4fa0-b6e3-b44e2ecd25e9-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Acquiring lock "cinder-quobyte-30336c03-d956-4fa0-b6e3-b44e2ecd25e9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Lock "cinder-quobyte-30336c03-d956-4fa0-b6e3-b44e2ecd25e9" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dba000-9515-40db-9ae7-80ebb7041cf6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:36 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 Sep 28 12:25:36 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:37 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9" returned: 0 in 0.433s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:37 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9 Sep 28 12:25:37 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:37 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-30336c03-d956-4fa0-b6e3-b44e2ecd25e9" returned: 0 in 0.331s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Lock "cinder-quobyte-30336c03-d956-4fa0-b6e3-b44e2ecd25e9" released by "delete_volume" :: held 0.830s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Created reservations ['a7e9d20a-93bb-49af-b034-9cc32713e5a5', 'e87f52d5-31fd-42c1-86da-5bfe62529d65', 'ec8fe4cd-362e-4a90-886d-2334f67296db', '1477b4f7-840a-4f19-a6d3-aac003e421df'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:37 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:37 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:37 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.396s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Deleted volume successfully. Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b50bfd98-59ec-402a-ae69-0d1abde3e04a tempest-VolumesTransfersV357Test-1523548466 None] Lock "cinder-30336c03-d956-4fa0-b6e3-b44e2ecd25e9-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Flow 'volume_create_manager' (ca584a13-53a8-4a98-b39d-ed75ac69ebb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e6a87d-dc2a-4f3c-aa6f-32ac7a7b0123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e6a87d-dc2a-4f3c-aa6f-32ac7a7b0123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-625078629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4608bf8-f920-450a-bbe1-31e959f7a1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c503f7cb14245f7bdd6e05dec63715e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:38Z,use_quota=True,user_id='17be7f9f2bb84848b60d61db3d206e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68d594b-b861-4573-88b6-224e71b7cfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68d594b-b861-4573-88b6-224e71b7cfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287aee0f-4b4e-419c-8855-f1391a10df17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287aee0f-4b4e-419c-8855-f1391a10df17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4608bf8-f920-450a-bbe1-31e959f7a1dd', 'volume_name': 'volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714684ef-5e29-4627-8df2-b162f9ad7489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714684ef-5e29-4627-8df2-b162f9ad7489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d133481-444e-404a-ab80-dfc0c83516b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Volume a4608bf8-f920-450a-bbe1-31e959f7a1dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd', 'volume_size': 1} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-625078629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4608bf8-f920-450a-bbe1-31e959f7a1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c503f7cb14245f7bdd6e05dec63715e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:38Z,use_quota=True,user_id='17be7f9f2bb84848b60d61db3d206e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Creating volume a4608bf8-f920-450a-bbe1-31e959f7a1dd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:38 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:38 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd 1073741824 Sep 28 12:25:38 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:38 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd 1073741824" returned: 0 in 0.569s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:39 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd Sep 28 12:25:39 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:39 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d133481-444e-404a-ab80-dfc0c83516b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04492b27-0904-4a6d-9982-6e2906f87044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:39 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Volume volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd (a4608bf8-f920-450a-bbe1-31e959f7a1dd): created successfully Sep 28 12:25:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04492b27-0904-4a6d-9982-6e2906f87044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:39 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Flow 'volume_create_manager' (ca584a13-53a8-4a98-b39d-ed75ac69ebb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4124f284-88c2-4dfc-962c-8918db2375c1 tempest-VolumesTransfersV357Test-1822211939 None] Created volume successfully. Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Flow 'volume_create_manager' (e71822c6-fab7-41f0-b2c3-0d8f458b0aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ce7b09-d4ae-4f87-ba40-b0d15653afda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ce7b09-d4ae-4f87-ba40-b0d15653afda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1431412571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677fe885-7940-4c57-b08c-24f4f9e5fcad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2aaa6fdc1d645eb9b338899f3b903c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:40Z,use_quota=True,user_id='1b7769af43304e9f9df8b6342e5ac45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da28a2ef-c372-4b04-bd20-b9ba6e7d918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da28a2ef-c372-4b04-bd20-b9ba6e7d918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa09395-33e6-4243-8e05-c421f019c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa09395-33e6-4243-8e05-c421f019c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677fe885-7940-4c57-b08c-24f4f9e5fcad', 'volume_name': 'volume-677fe885-7940-4c57-b08c-24f4f9e5fcad', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8762b14f-332b-42a8-bf0c-e979492bbdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8762b14f-332b-42a8-bf0c-e979492bbdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cdb02b-6f8a-4ad6-8a6f-5458d87ff3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Volume 677fe885-7940-4c57-b08c-24f4f9e5fcad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677fe885-7940-4c57-b08c-24f4f9e5fcad', 'volume_size': 1} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1431412571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677fe885-7940-4c57-b08c-24f4f9e5fcad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2aaa6fdc1d645eb9b338899f3b903c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:40Z,use_quota=True,user_id='1b7769af43304e9f9df8b6342e5ac45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Creating volume 677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:40 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad 1073741824 Sep 28 12:25:40 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:40 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad 1073741824" returned: 0 in 0.613s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Acquiring lock "cinder-a4608bf8-f920-450a-bbe1-31e959f7a1dd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:40 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad Sep 28 12:25:40 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Lock "cinder-a4608bf8-f920-450a-bbe1-31e959f7a1dd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Acquiring lock "cinder-quobyte-a4608bf8-f920-450a-bbe1-31e959f7a1dd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Lock "cinder-quobyte-a4608bf8-f920-450a-bbe1-31e959f7a1dd" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eae5400-4fd3-46cf-b43c-755a904e7acb]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:41 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad" returned: 0 in 0.302s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:41 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd Sep 28 12:25:41 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cdb02b-6f8a-4ad6-8a6f-5458d87ff3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677fe885-7940-4c57-b08c-24f4f9e5fcad', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7de2aa-3e1c-4920-beef-d4e574f4fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Volume volume-677fe885-7940-4c57-b08c-24f4f9e5fcad (677fe885-7940-4c57-b08c-24f4f9e5fcad): created successfully Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7de2aa-3e1c-4920-beef-d4e574f4fe06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Flow 'volume_create_manager' (e71822c6-fab7-41f0-b2c3-0d8f458b0aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7e147204-1570-4fdb-9eec-66421e73d8f4 tempest-VolumeDependencyTests-1450209065 None] Created volume successfully. Sep 28 12:25:41 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd" returned: 0 in 0.427s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:41 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd Sep 28 12:25:41 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:41 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4608bf8-f920-450a-bbe1-31e959f7a1dd" returned: 0 in 0.276s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Lock "cinder-quobyte-a4608bf8-f920-450a-bbe1-31e959f7a1dd" released by "delete_volume" :: held 0.770s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Created reservations ['ecc14201-5938-4c68-8105-037af70797a4', 'ad8d34af-c77c-4600-aaed-67737fd05b44', 'c52c6595-665f-4c6a-b5bb-0fe15e48b9c0', 'bd46aff5-4d62-45f2-a129-62fffed5260d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:41 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:41 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:42 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.312s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Deleted volume successfully. Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6a00d4b6-b37f-4f49-b4f8-fe6af9de1931 tempest-VolumesTransfersV357Test-1523548466 None] Lock "cinder-a4608bf8-f920-450a-bbe1-31e959f7a1dd-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Creating offline snapshot 3f67e175-0ce9-4460-876d-f01b125087d7 of volume 677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c2a380-d50e-4781-a0f3-38eb169ddc31]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:42 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad Sep 28 12:25:42 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:42 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad" returned: 0 in 0.434s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:42 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 1G Sep 28 12:25:42 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:43 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 1G" returned: 0 in 0.463s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-677fe885-7940-4c57-b08c-24f4f9e5fcad -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:43 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-677fe885-7940-4c57-b08c-24f4f9e5fcad -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 Sep 28 12:25:43 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:43 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-677fe885-7940-4c57-b08c-24f4f9e5fcad -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7" returned: 0 in 0.323s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:43 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 is being set with open permissions: ugo+rw Sep 28 12:25:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:43 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 Sep 28 12:25:43 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:43 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7" returned: 0 in 0.294s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:44 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.info Sep 28 12:25:44 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:44 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.info" returned: 0 in 0.263s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:44 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.info is being set with open permissions: ugo+rw Sep 28 12:25:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:44 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.info Sep 28 12:25:44 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:44 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.info" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:44 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c99806ae-5dd9-4214-b5b2-0439b1dd3208 tempest-VolumeDependencyTests-1450209065 None] Create snapshot completed successfully Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:49 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:25:49 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:49 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.252s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:25:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Flow 'volume_create_manager' (a138edec-8f6e-4614-a1c6-bc904c1326ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87558f1f-6b5d-4a15-a9f6-694820199b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87558f1f-6b5d-4a15-a9f6-694820199b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1339364170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669e53a8-8134-495a-aeb9-6df1a074aa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2aaa6fdc1d645eb9b338899f3b903c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3f67e175-0ce9-4460-876d-f01b125087d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:52Z,use_quota=True,user_id='1b7769af43304e9f9df8b6342e5ac45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9cfdbd-80d3-42e0-9dd8-99b462ebf91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9cfdbd-80d3-42e0-9dd8-99b462ebf91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1a767e-0d69-4ee4-99ba-0cc0e45aa060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1a767e-0d69-4ee4-99ba-0cc0e45aa060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '669e53a8-8134-495a-aeb9-6df1a074aa7f', 'volume_name': 'volume-669e53a8-8134-495a-aeb9-6df1a074aa7f', 'volume_size': 1, 'snapshot_id': '3f67e175-0ce9-4460-876d-f01b125087d7'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c244eeb7-9791-4702-9d29-9a5142f805ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c244eeb7-9791-4702-9d29-9a5142f805ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae89f97d-e2eb-41c6-9f48-ea9857538ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Volume 669e53a8-8134-495a-aeb9-6df1a074aa7f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-669e53a8-8134-495a-aeb9-6df1a074aa7f', 'volume_size': 1, 'snapshot_id': '3f67e175-0ce9-4460-876d-f01b125087d7'} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-quobyte-3f67e175-0ce9-4460-876d-f01b125087d7-669e53a8-8134-495a-aeb9-6df1a074aa7f" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-3f67e175-0ce9-4460-876d-f01b125087d7-669e53a8-8134-495a-aeb9-6df1a074aa7f" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Creating volume 669e53a8-8134-495a-aeb9-6df1a074aa7f from snapshot 3f67e175-0ce9-4460-876d-f01b125087d7 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-quobyte-669e53a8-8134-495a-aeb9-6df1a074aa7f" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-669e53a8-8134-495a-aeb9-6df1a074aa7f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] snapshot: 3f67e175-0ce9-4460-876d-f01b125087d7, volume: 669e53a8-8134-495a-aeb9-6df1a074aa7f, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b4c05b-1320-42f9-b319-cdea5b873b8d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:52 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 Sep 28 12:25:52 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:52 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7" returned: 0 in 0.398s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-677fe885-7940-4c57-b08c-24f4f9e5fcad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f04fdd-e779-4450-8a2d-67090f5db90d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:52 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad Sep 28 12:25:52 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:52 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad" returned: 0 in 0.390s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:25:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:52 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f Sep 28 12:25:52 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:00 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f" returned: 0 in 7.353s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:26:00 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Converted 1024.00 MB image at 139.23 MB/s Sep 28 12:26:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f is being set with open permissions: ugo+rw Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:00 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f Sep 28 12:26:00 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:00 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f" returned: 0 in 0.264s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-669e53a8-8134-495a-aeb9-6df1a074aa7f" released by "_copy_volume_from_snapshot" :: held 8.501s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-3f67e175-0ce9-4460-876d-f01b125087d7-669e53a8-8134-495a-aeb9-6df1a074aa7f" released by "_create_volume_from_snapshot" :: held 8.566s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.592s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae89f97d-e2eb-41c6-9f48-ea9857538ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669e53a8-8134-495a-aeb9-6df1a074aa7f', 'volume_size': 1, 'snapshot_id': '3f67e175-0ce9-4460-876d-f01b125087d7'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfc5bda-53a2-4d8c-96f7-15387732e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Volume volume-669e53a8-8134-495a-aeb9-6df1a074aa7f (669e53a8-8134-495a-aeb9-6df1a074aa7f): created successfully Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfc5bda-53a2-4d8c-96f7-15387732e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Flow 'volume_create_manager' (a138edec-8f6e-4614-a1c6-bc904c1326ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-20e2dd8a-f148-4300-b053-850efa4a83d5 tempest-VolumeDependencyTests-1450209065 None] Created volume successfully. Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-3f67e175-0ce9-4460-876d-f01b125087d7-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-3f67e175-0ce9-4460-876d-f01b125087d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-quobyte-677fe885-7940-4c57-b08c-24f4f9e5fcad" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-677fe885-7940-4c57-b08c-24f4f9e5fcad" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-quobyte-3f67e175-0ce9-4460-876d-f01b125087d7" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-3f67e175-0ce9-4460-876d-f01b125087d7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Deleting offline snapshot 3f67e175-0ce9-4460-876d-f01b125087d7 of volume 677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] snapshot_file for this snap is: volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e2f768-a840-41cf-bb91-528fd01d4b07]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:00 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 Sep 28 12:26:00 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:01 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7" returned: 0 in 0.379s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-677fe885-7940-4c57-b08c-24f4f9e5fcad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:26:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[add19a29-0b35-4e99-bf45-2817c0ff214b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:01 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad Sep 28 12:26:01 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:01 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad" returned: 0 in 0.645s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:01 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 Sep 28 12:26:01 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:02 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7" returned: 0 in 0.412s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:02 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7 Sep 28 12:26:02 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:02 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad.3f67e175-0ce9-4460-876d-f01b125087d7" returned: 0 in 0.308s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-3f67e175-0ce9-4460-876d-f01b125087d7" released by "_delete_snapshot" :: held 1.873s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-677fe885-7940-4c57-b08c-24f4f9e5fcad" released by "delete_snapshot" :: held 1.895s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Created reservations ['33c36272-1033-4cae-90b6-1eb2ec6738f5', '837ca676-83af-42d5-a50f-e333a3329bc3', '5b5ec1d9-8022-4366-813c-fe72f92a3480', 'ad800295-9419-4f21-b195-a6797cf9e353'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Delete snapshot completed successfully. Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3a48c954-26a7-4504-aed7-c9238758f434 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-3f67e175-0ce9-4460-876d-f01b125087d7-delete_snapshot" released by "delete_snapshot" :: held 2.066s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-677fe885-7940-4c57-b08c-24f4f9e5fcad-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-677fe885-7940-4c57-b08c-24f4f9e5fcad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-quobyte-677fe885-7940-4c57-b08c-24f4f9e5fcad" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-677fe885-7940-4c57-b08c-24f4f9e5fcad" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd17c045-f10a-49be-9917-63b6d9a86565]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:03 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad Sep 28 12:26:03 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:03 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad" returned: 0 in 0.445s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:03 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad Sep 28 12:26:03 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:03 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-677fe885-7940-4c57-b08c-24f4f9e5fcad" returned: 0 in 0.303s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-677fe885-7940-4c57-b08c-24f4f9e5fcad" released by "delete_volume" :: held 0.829s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Created reservations ['0a224e1f-6aa5-4c44-a3d3-edb53b280f29', 'b0e700a4-844a-4611-9907-ee06d41c2840', '1b4f2fae-65fc-4011-af33-184485002846', '4a717c61-8930-4534-a341-529d8dbe42cc'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:03 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:26:03 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-669e53a8-8134-495a-aeb9-6df1a074aa7f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-669e53a8-8134-495a-aeb9-6df1a074aa7f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "cinder-quobyte-669e53a8-8134-495a-aeb9-6df1a074aa7f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-669e53a8-8134-495a-aeb9-6df1a074aa7f" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891ff15-0dd9-4823-9956-3ff2a8bfd13a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:04 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.391s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Deleted volume successfully. Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81f419e5-3f8a-448b-93c0-cc115a86c31d tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-677fe885-7940-4c57-b08c-24f4f9e5fcad-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:04 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f Sep 28 12:26:04 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:04 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f" returned: 0 in 0.445s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:04 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f Sep 28 12:26:04 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:04 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-669e53a8-8134-495a-aeb9-6df1a074aa7f" returned: 0 in 0.282s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-quobyte-669e53a8-8134-495a-aeb9-6df1a074aa7f" released by "delete_volume" :: held 0.793s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Created reservations ['1f2bcb39-d884-4e92-8c0f-2eef1279b9da', '553fa43a-819f-41e2-9b7d-10456692513b', '6013c0c5-c8e7-4633-9cdc-695fcb01acfc', 'c54d52e3-a4f4-4b57-9826-05791108ebcf'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:05 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:26:05 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:05 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.280s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Deleted volume successfully. Sep 28 12:26:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-00f98d5a-b9cc-4a09-a94a-0d857c7c0a10 tempest-VolumeDependencyTests-1450209065 None] Lock "cinder-669e53a8-8134-495a-aeb9-6df1a074aa7f-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Flow 'volume_create_manager' (0b65f03b-b90e-4c5f-ac26-a1859e61f00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71512ca8-afa3-4447-8255-7e543c5dfbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71512ca8-afa3-4447-8255-7e543c5dfbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-496066207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40824e79-9e24-4692-98a1-55d2b261ad01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950bb6fe1b134dc196761135c73daab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:08Z,use_quota=True,user_id='f91602af936d4fca8a8293f20e2004e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e664f6-a81b-4ea5-b5a8-433c1c2bf1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e664f6-a81b-4ea5-b5a8-433c1c2bf1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54c2515-2e5a-40fe-ab44-4e69e8525a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54c2515-2e5a-40fe-ab44-4e69e8525a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40824e79-9e24-4692-98a1-55d2b261ad01', 'volume_name': 'volume-40824e79-9e24-4692-98a1-55d2b261ad01', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647cb054-f6e7-42b1-a9f5-a5674239025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647cb054-f6e7-42b1-a9f5-a5674239025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448cbbe1-fb20-4a46-9a12-362161e96233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Volume 40824e79-9e24-4692-98a1-55d2b261ad01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40824e79-9e24-4692-98a1-55d2b261ad01', 'volume_size': 1} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-496066207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40824e79-9e24-4692-98a1-55d2b261ad01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='950bb6fe1b134dc196761135c73daab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:08Z,use_quota=True,user_id='f91602af936d4fca8a8293f20e2004e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Creating volume 40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:26:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:26:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:07 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 1073741824 Sep 28 12:26:07 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:08 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 1073741824" returned: 0 in 0.417s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:08 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:26:08 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:08 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.252s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448cbbe1-fb20-4a46-9a12-362161e96233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40824e79-9e24-4692-98a1-55d2b261ad01', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1faab2e7-37de-46ea-bf57-d49da01fbec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Volume volume-40824e79-9e24-4692-98a1-55d2b261ad01 (40824e79-9e24-4692-98a1-55d2b261ad01): created successfully Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1faab2e7-37de-46ea-bf57-d49da01fbec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Flow 'volume_create_manager' (0b65f03b-b90e-4c5f-ac26-a1859e61f00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-45552b2d-9855-4e8b-9fe6-88a00822c3d5 tempest-VolumesActionsTest-54287928 None] Created volume successfully. Sep 28 12:26:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-771fbe63-2e14-4b50-b2fb-a2a95d7c9a18 tempest-VolumesActionsTest-54287928 None] Acquiring lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01" by "attach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-771fbe63-2e14-4b50-b2fb-a2a95d7c9a18 tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01" acquired by "attach_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-771fbe63-2e14-4b50-b2fb-a2a95d7c9a18 tempest-VolumesActionsTest-54287928 None] Attaching volume 40824e79-9e24-4692-98a1-55d2b261ad01 to instance 67b19633-a831-43f6-91b8-583144ea2b92 at mountpoint /dev/vdb on host None. Sep 28 12:26:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-771fbe63-2e14-4b50-b2fb-a2a95d7c9a18 tempest-VolumesActionsTest-54287928 None] Attach volume completed successfully. Sep 28 12:26:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-771fbe63-2e14-4b50-b2fb-a2a95d7c9a18 tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01" released by "attach_volume" :: held 0.093s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a7469127-3219-40a9-9804-331eb2c5e738 tempest-VolumesActionsTest-54287928 None] Acquiring lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-detach_volume" by "detach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a7469127-3219-40a9-9804-331eb2c5e738 tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a7469127-3219-40a9-9804-331eb2c5e738 tempest-VolumesActionsTest-54287928 None] Detaching volume 40824e79-9e24-4692-98a1-55d2b261ad01 from instance 67b19633-a831-43f6-91b8-583144ea2b92. Sep 28 12:26:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a7469127-3219-40a9-9804-331eb2c5e738 tempest-VolumesActionsTest-54287928 None] Detach volume completed successfully. Sep 28 12:26:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a7469127-3219-40a9-9804-331eb2c5e738 tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:27 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=67,cinder:SELECT=50,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:26:27 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=47,cinder:INSERT=15,cinder:UPDATE=51,cinder:DELETE=5 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:26:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4fa107dc-2dac-4766-b06e-7095de0fbf18 tempest-VolumesActionsTest-54287928 None] Acquiring lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01" by "attach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4fa107dc-2dac-4766-b06e-7095de0fbf18 tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01" acquired by "attach_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4fa107dc-2dac-4766-b06e-7095de0fbf18 tempest-VolumesActionsTest-54287928 None] Attaching volume 40824e79-9e24-4692-98a1-55d2b261ad01 to instance cf96f183-dffd-4aad-813f-a4d507004430 at mountpoint /dev/vdb on host None. Sep 28 12:26:28 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4fa107dc-2dac-4766-b06e-7095de0fbf18 tempest-VolumesActionsTest-54287928 None] Attach volume completed successfully. Sep 28 12:26:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4fa107dc-2dac-4766-b06e-7095de0fbf18 tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01" released by "attach_volume" :: held 0.097s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4be15eeb-9e5b-442b-b8d3-2670c93d4299 tempest-VolumesActionsTest-54287928 None] Acquiring lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-detach_volume" by "detach_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4be15eeb-9e5b-442b-b8d3-2670c93d4299 tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4be15eeb-9e5b-442b-b8d3-2670c93d4299 tempest-VolumesActionsTest-54287928 None] Detaching volume 40824e79-9e24-4692-98a1-55d2b261ad01 from instance cf96f183-dffd-4aad-813f-a4d507004430. Sep 28 12:26:29 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4be15eeb-9e5b-442b-b8d3-2670c93d4299 tempest-VolumesActionsTest-54287928 None] Detach volume completed successfully. Sep 28 12:26:29 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4be15eeb-9e5b-442b-b8d3-2670c93d4299 tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:33 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a78bd2-7fea-466e-aaa7-3d9e712e7892]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:33 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:26:33 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:34 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.378s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac1bfe7-3a40-4af6-92dc-31b4ee37e013]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:34 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:26:34 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:34 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.371s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.9702f8a9-ff64-4388-a6b0-ab0d179bb637ap2n0zjz.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:34 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.9702f8a9-ff64-4388-a6b0-ab0d179bb637ap2n0zjz.img Sep 28 12:26:34 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:39 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:26:40 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.9702f8a9-ff64-4388-a6b0-ab0d179bb637ap2n0zjz.img" returned: 0 in 5.542s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a634a862-7a3c-4a90-8c6d-4474bef841ec]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:40 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:26:40 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:40 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.527s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:40 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.9702f8a9-ff64-4388-a6b0-ab0d179bb637ap2n0zjz.img {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:26:40 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Converted 1024.00 MB image at 184.71 MB/s Sep 28 12:26:40 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] 9702f8a9-ff64-4388-a6b0-ab0d179bb637 was raw, no need to convert to raw {{(pid=87167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:49 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:26:49 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:49 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.295s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:26:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:26:50 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:26:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.328s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Uploaded volume to glance image-id: 9702f8a9-ff64-4388-a6b0-ab0d179bb637. {{(pid=87167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 12:26:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d25084a7-a9f0-49d1-935a-9eccf5fcaf0d tempest-VolumesActionsTest-54287928 None] Copy volume to image completed successfully. Sep 28 12:27:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f2c59-257f-4eee-a6d0-cab4d7ad295d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:00 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:27:00 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:00 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dfa29f-ad2d-4323-b1a8-ae2e33ae6f79]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:01 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:27:01 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:01 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:01 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img Sep 28 12:27:01 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:07 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img" returned: 0 in 5.778s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f531abb2-fa59-4c4d-9110-dae5580bc928]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:07 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:27:07 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:07 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.529s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:27:07 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Converted 1024.00 MB image at 177.19 MB/s Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] 5a8e865c-2e91-4dee-a9c3-2d5e70018705 was raw, converting to qcow2 {{(pid=87167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b493d7-7b3d-4d38-967d-359cf5f1d5d8]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:07 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img Sep 28 12:27:07 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:07 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img" returned: 0 in 0.342s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:08 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img Sep 28 12:27:08 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:08 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img" returned: 1 in 0.329s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:27:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img /opt/stack/data/cinder/conversion/vol_upload_um0_qget {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:08 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img /opt/stack/data/cinder/conversion/vol_upload_um0_qget Sep 28 12:27:08 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:08 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img /opt/stack/data/cinder/conversion/vol_upload_um0_qget" returned: 0 in 0.254s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:08 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Image conversion details: src /opt/stack/data/cinder/conversion/40824e79-9e24-4692-98a1-55d2b261ad01.temp_image.5a8e865c-2e91-4dee-a9c3-2d5e70018705m3218u66.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_um0_qget {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:27:08 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 12:27:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c59941-6fa4-407f-8972-56584ec498ab]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_um0_qget {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:08 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_um0_qget Sep 28 12:27:08 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:08 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_um0_qget" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.607s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Uploaded volume to glance image-id: 5a8e865c-2e91-4dee-a9c3-2d5e70018705. {{(pid=87167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 12:27:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-789e0a7e-1995-4ae7-ace3-2da9db2ab1fa tempest-VolumesActionsTest-54287928 None] Copy volume to image completed successfully. Sep 28 12:27:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Acquiring lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Acquiring lock "cinder-quobyte-40824e79-9e24-4692-98a1-55d2b261ad01" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Lock "cinder-quobyte-40824e79-9e24-4692-98a1-55d2b261ad01" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac57321-6faf-4f51-8bbf-7eff55a1e06d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:11 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:27:11 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:12 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.358s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:12 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01 Sep 28 12:27:12 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:12 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-40824e79-9e24-4692-98a1-55d2b261ad01" returned: 0 in 0.252s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Lock "cinder-quobyte-40824e79-9e24-4692-98a1-55d2b261ad01" released by "delete_volume" :: held 0.647s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Created reservations ['6c3e0eed-4fe1-4733-9acf-882b08ab90b7', '9d397ba6-6187-46da-b00e-a9e6f71ab4a8', '2aa26bb7-bc26-4338-a33c-3f423e377682', '9699c032-4094-4c91-8e1f-f166c54e15f6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:12 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:27:12 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:12 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.245s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Deleted volume successfully. Sep 28 12:27:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-87c0eef9-21d0-4ddd-95e3-4b2c3089b9bf tempest-VolumesActionsTest-54287928 None] Lock "cinder-40824e79-9e24-4692-98a1-55d2b261ad01-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:22 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:27:22 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:49 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:27:49 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:49 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.265s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:27:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Flow 'volume_create_manager' (d7b2a43f-2473-415a-a57b-1395313c0f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1d8c64-cb9c-4dcb-a3f6-8e8835cc7354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1d8c64-cb9c-4dcb-a3f6-8e8835cc7354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1794867407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94834f22-8025-4e44-b844-3bd75ccaccd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1a9abc88a24257b062ea6dbfdec504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:53Z,use_quota=True,user_id='86b6673e790b484eb820dd82d43ee66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2686b1f6-f5ea-4965-9be7-03659cea7cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2686b1f6-f5ea-4965-9be7-03659cea7cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fc8abb-8743-4f3d-978f-ca55983803e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0fc8abb-8743-4f3d-978f-ca55983803e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94834f22-8025-4e44-b844-3bd75ccaccd0', 'volume_name': 'volume-94834f22-8025-4e44-b844-3bd75ccaccd0', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bbf676-55ca-4d0e-b881-cef0a3fff32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bbf676-55ca-4d0e-b881-cef0a3fff32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7a84ea-b749-438b-96a3-d6adf9643148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:53 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Volume 94834f22-8025-4e44-b844-3bd75ccaccd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94834f22-8025-4e44-b844-3bd75ccaccd0', 'volume_size': 1} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1794867407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94834f22-8025-4e44-b844-3bd75ccaccd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a1a9abc88a24257b062ea6dbfdec504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:53Z,use_quota=True,user_id='86b6673e790b484eb820dd82d43ee66e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Creating volume 94834f22-8025-4e44-b844-3bd75ccaccd0 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:27:53 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:53 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 1073741824 Sep 28 12:27:53 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:53 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 1073741824" returned: 0 in 0.504s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:53 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 Sep 28 12:27:53 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:54 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0" returned: 0 in 0.260s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:27:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7a84ea-b749-438b-96a3-d6adf9643148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94834f22-8025-4e44-b844-3bd75ccaccd0', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba593c9-c44d-46ef-9ed6-6a606e35c65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:54 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Volume volume-94834f22-8025-4e44-b844-3bd75ccaccd0 (94834f22-8025-4e44-b844-3bd75ccaccd0): created successfully Sep 28 12:27:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba593c9-c44d-46ef-9ed6-6a606e35c65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Flow 'volume_create_manager' (d7b2a43f-2473-415a-a57b-1395313c0f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-37f21f63-d33f-44a2-a545-1d6ceb253a9a tempest-TestMinimumBasicScenario-1332429286 None] Created volume successfully. Sep 28 12:27:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2d8fc7aa-d80b-4ca5-a918-cecbd8d8394e req-9c0fea7a-3eeb-49cc-a3a6-ee6783789b8b tempest-TestMinimumBasicScenario-1332429286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2d8fc7aa-d80b-4ca5-a918-cecbd8d8394e req-9c0fea7a-3eeb-49cc-a3a6-ee6783789b8b tempest-TestMinimumBasicScenario-1332429286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2d8fc7aa-d80b-4ca5-a918-cecbd8d8394e req-9c0fea7a-3eeb-49cc-a3a6-ee6783789b8b tempest-TestMinimumBasicScenario-1332429286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-2d8fc7aa-d80b-4ca5-a918-cecbd8d8394e req-9c0fea7a-3eeb-49cc-a3a6-ee6783789b8b tempest-TestMinimumBasicScenario-1332429286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-94834f22-8025-4e44-b844-3bd75ccaccd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f44832a-4b8c-4d92-ac92-257e3c6e8357', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:27:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-2d8fc7aa-d80b-4ca5-a918-cecbd8d8394e req-9c0fea7a-3eeb-49cc-a3a6-ee6783789b8b tempest-TestMinimumBasicScenario-1332429286 None] attachment_update completed successfully. Sep 28 12:28:06 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:28:06 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:28:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-c1b9e649-4ddf-4400-887e-ae7e5bb0611c req-fb3f2ba7-ab5c-4be2-b726-62c95da92a6c tempest-TestMinimumBasicScenario-1332429286 None] Terminate volume connection completed successfully. Sep 28 12:28:43 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-c1b9e649-4ddf-4400-887e-ae7e5bb0611c req-fb3f2ba7-ab5c-4be2-b726-62c95da92a6c tempest-TestMinimumBasicScenario-1332429286 None] Deleting attachment 1f44832a-4b8c-4d92-ac92-257e3c6e8357. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Acquiring lock "cinder-94834f22-8025-4e44-b844-3bd75ccaccd0-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Lock "cinder-94834f22-8025-4e44-b844-3bd75ccaccd0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Acquiring lock "cinder-quobyte-94834f22-8025-4e44-b844-3bd75ccaccd0" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Lock "cinder-quobyte-94834f22-8025-4e44-b844-3bd75ccaccd0" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cba2ea-f461-40d3-993a-131a87d1b9bd]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:44 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 Sep 28 12:28:44 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:44 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0" returned: 0 in 0.370s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:44 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0 Sep 28 12:28:44 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:44 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-94834f22-8025-4e44-b844-3bd75ccaccd0" returned: 0 in 0.250s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:44 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Lock "cinder-quobyte-94834f22-8025-4e44-b844-3bd75ccaccd0" released by "delete_volume" :: held 0.668s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Created reservations ['17416f2d-023e-4ee2-a498-c7604124f646', '063a1380-53c5-45f4-9003-22d750050eaa', '5f76c422-a2d0-4a82-be84-1e231619b63b', 'dc095ef0-b08a-442e-8782-91eaf236801c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:45 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:28:45 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:45 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.248s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Deleted volume successfully. Sep 28 12:28:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9f4a0f57-7537-4681-ad05-3b965dcdfb39 tempest-TestMinimumBasicScenario-1332429286 None] Lock "cinder-94834f22-8025-4e44-b844-3bd75ccaccd0-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:49 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:28:49 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:49 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.274s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:28:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:28:55 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:28:55 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Flow 'volume_create_manager' (e1645cea-38d5-4d30-ae21-f26b4e28a646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33754fec-a529-4ea7-a6da-e65387463fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33754fec-a529-4ea7-a6da-e65387463fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-291620326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dd17db-8d63-44af-85dd-88af7e720ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ac735a8def4539b66872fec78393a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:21Z,use_quota=True,user_id='ea102070c1424dcaa5f1908c627df60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f12ffce-01a5-4e31-82ba-b70a567d736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f12ffce-01a5-4e31-82ba-b70a567d736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76b3989-39d2-42e4-8622-f4180c1136d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76b3989-39d2-42e4-8622-f4180c1136d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dd17db-8d63-44af-85dd-88af7e720ded', 'volume_name': 'volume-e0dd17db-8d63-44af-85dd-88af7e720ded', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9f172b-60cd-49b2-92e7-05239769139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9f172b-60cd-49b2-92e7-05239769139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9f0416-ebb2-4dd5-9bc1-0c2c02187dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Volume e0dd17db-8d63-44af-85dd-88af7e720ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dd17db-8d63-44af-85dd-88af7e720ded', 'volume_size': 1} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-291620326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dd17db-8d63-44af-85dd-88af7e720ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ac735a8def4539b66872fec78393a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:21Z,use_quota=True,user_id='ea102070c1424dcaa5f1908c627df60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Creating volume e0dd17db-8d63-44af-85dd-88af7e720ded {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:29:21 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:21 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded 1073741824 Sep 28 12:29:21 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:29:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Flow 'volume_create_manager' (429169b5-9061-4795-acd3-af9bba53b56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9e1154-7f4a-4443-b270-f4c9ea71527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9e1154-7f4a-4443-b270-f4c9ea71527e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1027640869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc1be94-1bfd-4259-aafb-df2e0d44815a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ac735a8def4539b66872fec78393a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:22Z,use_quota=True,user_id='ea102070c1424dcaa5f1908c627df60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68602fd8-fb18-437b-84a4-ebc2048ca539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68602fd8-fb18-437b-84a4-ebc2048ca539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7909893-7fe4-4f6c-872b-c5ff0c09ba36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7909893-7fe4-4f6c-872b-c5ff0c09ba36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc1be94-1bfd-4259-aafb-df2e0d44815a', 'volume_name': 'volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1b22c8-f13c-4738-8c5e-7822f73feabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1b22c8-f13c-4738-8c5e-7822f73feabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b841b16-be00-4c2d-94f3-6433141fc350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:22 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Volume 2bc1be94-1bfd-4259-aafb-df2e0d44815a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a', 'volume_size': 1} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:22 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded 1073741824" returned: 0 in 0.585s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:22 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded Sep 28 12:29:22 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:22 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded" returned: 0 in 0.318s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1027640869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc1be94-1bfd-4259-aafb-df2e0d44815a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ac735a8def4539b66872fec78393a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:22Z,use_quota=True,user_id='ea102070c1424dcaa5f1908c627df60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Creating volume 2bc1be94-1bfd-4259-aafb-df2e0d44815a {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:29:22 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:22 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a 1073741824 Sep 28 12:29:22 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9f0416-ebb2-4dd5-9bc1-0c2c02187dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dd17db-8d63-44af-85dd-88af7e720ded', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0622ed-12b6-4bd2-b848-a5fbe444900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:22 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Volume volume-e0dd17db-8d63-44af-85dd-88af7e720ded (e0dd17db-8d63-44af-85dd-88af7e720ded): created successfully Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0622ed-12b6-4bd2-b848-a5fbe444900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Flow 'volume_create_manager' (e1645cea-38d5-4d30-ae21-f26b4e28a646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9b4b5d60-b648-4a72-ac7c-6c54583f05b1 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Created volume successfully. Sep 28 12:29:23 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a 1073741824" returned: 0 in 0.548s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:23 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a Sep 28 12:29:23 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:23 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a" returned: 0 in 0.262s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b841b16-be00-4c2d-94f3-6433141fc350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a5096c-b554-4cf8-8aaa-158ddd6d9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Volume volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a (2bc1be94-1bfd-4259-aafb-df2e0d44815a): created successfully Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a5096c-b554-4cf8-8aaa-158ddd6d9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Flow 'volume_create_manager' (429169b5-9061-4795-acd3-af9bba53b56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-94a92130-5504-4755-a366-c2ab72678d40 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Created volume successfully. Sep 28 12:29:33 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:INSERT=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:29:33 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:49 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:29:49 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:49 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.265s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:29:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:29:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-3711ae79-30ff-481a-a8f8-0f9ded52c490 req-b0fc60db-e6f2-41ea-afd5-3b5df117159c tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-3711ae79-30ff-481a-a8f8-0f9ded52c490 req-b0fc60db-e6f2-41ea-afd5-3b5df117159c tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-3711ae79-30ff-481a-a8f8-0f9ded52c490 req-b0fc60db-e6f2-41ea-afd5-3b5df117159c tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-3711ae79-30ff-481a-a8f8-0f9ded52c490 req-b0fc60db-e6f2-41ea-afd5-3b5df117159c tempest-TestServerVolumeAttachmentScenario-1427196520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-e0dd17db-8d63-44af-85dd-88af7e720ded', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bde13cdb-94c5-43d0-98b4-044bfaba06bb', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:29:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-3711ae79-30ff-481a-a8f8-0f9ded52c490 req-b0fc60db-e6f2-41ea-afd5-3b5df117159c tempest-TestServerVolumeAttachmentScenario-1427196520 None] attachment_update completed successfully. Sep 28 12:29:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2d88e3cb-084d-47c3-b0d4-9523cdcb8e86 req-a153bc9c-c8a1-4cd6-bb8f-8e6999b8492b tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2d88e3cb-084d-47c3-b0d4-9523cdcb8e86 req-a153bc9c-c8a1-4cd6-bb8f-8e6999b8492b tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-2d88e3cb-084d-47c3-b0d4-9523cdcb8e86 req-a153bc9c-c8a1-4cd6-bb8f-8e6999b8492b tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:59 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-2d88e3cb-084d-47c3-b0d4-9523cdcb8e86 req-a153bc9c-c8a1-4cd6-bb8f-8e6999b8492b tempest-TestServerVolumeAttachmentScenario-1427196520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e91b5b57-d72e-4d85-9968-312aa7392225', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:29:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-2d88e3cb-084d-47c3-b0d4-9523cdcb8e86 req-a153bc9c-c8a1-4cd6-bb8f-8e6999b8492b tempest-TestServerVolumeAttachmentScenario-1427196520 None] attachment_update completed successfully. Sep 28 12:30:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-0dc4d554-f01e-4a41-b88d-4eaa1dd8dd6e req-5c4f6b8d-c174-443e-94e1-bf2b8c26d9b7 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Terminate volume connection completed successfully. Sep 28 12:30:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-0dc4d554-f01e-4a41-b88d-4eaa1dd8dd6e req-5c4f6b8d-c174-443e-94e1-bf2b8c26d9b7 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Deleting attachment e91b5b57-d72e-4d85-9968-312aa7392225. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:30:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-b50aff04-e9d0-4be7-b1b8-ecdd289585d1 req-03081c82-60a3-4206-ac33-b7fa379ded08 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Terminate volume connection completed successfully. Sep 28 12:30:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-b50aff04-e9d0-4be7-b1b8-ecdd289585d1 req-03081c82-60a3-4206-ac33-b7fa379ded08 tempest-TestServerVolumeAttachmentScenario-1427196520 None] Deleting attachment bde13cdb-94c5-43d0-98b4-044bfaba06bb. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:30:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "cinder-2bc1be94-1bfd-4259-aafb-df2e0d44815a-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "cinder-2bc1be94-1bfd-4259-aafb-df2e0d44815a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "cinder-quobyte-2bc1be94-1bfd-4259-aafb-df2e0d44815a" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "cinder-quobyte-2bc1be94-1bfd-4259-aafb-df2e0d44815a" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:06 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c2e174-b0c5-4d17-b0bb-c9f2242a99a3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:07 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a Sep 28 12:30:07 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:07 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a" returned: 0 in 0.371s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:07 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a Sep 28 12:30:07 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:07 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2bc1be94-1bfd-4259-aafb-df2e0d44815a" returned: 0 in 0.264s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "cinder-quobyte-2bc1be94-1bfd-4259-aafb-df2e0d44815a" released by "delete_volume" :: held 0.678s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Created reservations ['91798178-e592-4323-b65e-50e9d00312e8', 'ec48e898-abe7-47b6-ba31-f6e8107eb174', '21dfe26b-bf27-44a1-afbe-93f53ef0d493', 'c7f6c72a-7eba-4174-8eac-c42619ed1ce9'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:07 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:30:07 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:08 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.262s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Deleted volume successfully. Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "cinder-e0dd17db-8d63-44af-85dd-88af7e720ded-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-710e8ff6-a7e2-4b31-81ee-50d34061b24e tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "cinder-2bc1be94-1bfd-4259-aafb-df2e0d44815a-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "cinder-e0dd17db-8d63-44af-85dd-88af7e720ded-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "cinder-quobyte-e0dd17db-8d63-44af-85dd-88af7e720ded" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "cinder-quobyte-e0dd17db-8d63-44af-85dd-88af7e720ded" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6d374f-c295-400c-96dd-bfee6ed44118]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:08 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded Sep 28 12:30:08 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:08 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded" returned: 0 in 0.380s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:08 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded Sep 28 12:30:08 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:08 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e0dd17db-8d63-44af-85dd-88af7e720ded" returned: 0 in 0.264s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "cinder-quobyte-e0dd17db-8d63-44af-85dd-88af7e720ded" released by "delete_volume" :: held 0.689s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Created reservations ['e7771a77-7b44-415a-bbcd-c6967be4dd04', '71f6b001-628b-4377-b605-69dac0f2dd84', '11a9eba2-f65d-4cb2-9286-acbcc95f5f76', 'fd34b09b-c2a0-4b82-b4db-e04bad6522db'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:08 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:30:08 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:09 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:09 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Deleted volume successfully. Sep 28 12:30:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d5237eb4-998c-436e-af10-ecc09804fd3a tempest-TestServerVolumeAttachmentScenario-1427196520 None] Lock "cinder-e0dd17db-8d63-44af-85dd-88af7e720ded-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:18 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=24,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:30:19 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=26,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Flow 'volume_create_manager' (3d52c61f-e981-4837-b29b-6b791c743c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5442c738-8895-4ab2-b715-c0aca2c82f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5442c738-8895-4ab2-b715-c0aca2c82f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1227593864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8734cd5f-614b-4f60-aba0-dbe7f3a123e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a4828682c74cf485ec8e5c1c2b20a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:40Z,use_quota=True,user_id='9efe7f441b534585adab7804501a3198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3312f0-6ad3-4bf2-9346-11f773288636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3312f0-6ad3-4bf2-9346-11f773288636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52ab448-8558-46c3-b8f6-d7b503a4e7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52ab448-8558-46c3-b8f6-d7b503a4e7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8734cd5f-614b-4f60-aba0-dbe7f3a123e7', 'volume_name': 'volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bd0c20-dd99-4879-9fee-7218346d8182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38bd0c20-dd99-4879-9fee-7218346d8182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725eb3d7-e342-4c85-88aa-f789cc228e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Volume 8734cd5f-614b-4f60-aba0-dbe7f3a123e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7', 'volume_size': 1} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1227593864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8734cd5f-614b-4f60-aba0-dbe7f3a123e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a4828682c74cf485ec8e5c1c2b20a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:40Z,use_quota=True,user_id='9efe7f441b534585adab7804501a3198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Creating volume 8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:40 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:40 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 1073741824 Sep 28 12:30:40 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:40 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 1073741824" returned: 0 in 0.460s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:40 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 Sep 28 12:30:40 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:41 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" returned: 0 in 0.266s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:30:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725eb3d7-e342-4c85-88aa-f789cc228e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e96253a-9169-4645-b905-4df18665136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:41 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Volume volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 (8734cd5f-614b-4f60-aba0-dbe7f3a123e7): created successfully Sep 28 12:30:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e96253a-9169-4645-b905-4df18665136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:41 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Flow 'volume_create_manager' (3d52c61f-e981-4837-b29b-6b791c743c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-07d92999-f6d4-4fc9-9a7d-68ff470789e6 tempest-TestStampPattern-218470353 None] Created volume successfully. Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:49 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:30:49 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:49 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.308s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:30:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:30:51 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:30:51 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:31:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e196fe0f-8e1c-42e0-a7c0-afb768dcf70d req-3077cdfc-e470-4537-a101-0aec7993773b tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e196fe0f-8e1c-42e0-a7c0-afb768dcf70d req-3077cdfc-e470-4537-a101-0aec7993773b tempest-TestStampPattern-218470353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-e196fe0f-8e1c-42e0-a7c0-afb768dcf70d req-3077cdfc-e470-4537-a101-0aec7993773b tempest-TestStampPattern-218470353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-e196fe0f-8e1c-42e0-a7c0-afb768dcf70d req-3077cdfc-e470-4537-a101-0aec7993773b tempest-TestStampPattern-218470353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '410e1533-9648-4ac8-9fc8-5862876812e8', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:31:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-e196fe0f-8e1c-42e0-a7c0-afb768dcf70d req-3077cdfc-e470-4537-a101-0aec7993773b tempest-TestStampPattern-218470353 None] attachment_update completed successfully. Sep 28 12:31:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-d2254363-ab53-4877-acc5-807a01418b41 req-82796656-b6fe-4f8d-ac1a-fa72577082e9 tempest-TestStampPattern-218470353 None] Terminate volume connection completed successfully. Sep 28 12:31:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-d2254363-ab53-4877-acc5-807a01418b41 req-82796656-b6fe-4f8d-ac1a-fa72577082e9 tempest-TestStampPattern-218470353 None] Deleting attachment 410e1533-9648-4ac8-9fc8-5862876812e8. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:31:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Creating offline snapshot b785435a-7f90-49b8-b4ec-b94536c2b25c of volume 8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:31:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[822034c1-83d4-4c9e-bb41-91fa2abd1872]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:16 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 Sep 28 12:31:16 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:17 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:17 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c 1G Sep 28 12:31:17 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:17 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c 1G" returned: 0 in 0.397s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:17 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c Sep 28 12:31:17 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:17 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:17 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c is being set with open permissions: ugo+rw Sep 28 12:31:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:17 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c Sep 28 12:31:17 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:18 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c" returned: 0 in 0.255s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:18 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.info Sep 28 12:31:18 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:18 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.info" returned: 0 in 0.250s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:18 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.info is being set with open permissions: ugo+rw Sep 28 12:31:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:18 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.info Sep 28 12:31:18 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:18 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.info" returned: 0 in 0.246s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3141ba81-6dbf-4e35-8782-341c1d1ef114 tempest-TestStampPattern-218470353 None] Create snapshot completed successfully Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Flow 'volume_create_manager' (ad238fc6-082c-4a48-82f9-339ea26e25cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a07483-ed60-4f4e-867a-f21ea737ac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a07483-ed60-4f4e-867a-f21ea737ac6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-663401450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09f6fde-285c-4a35-8df9-10984d8bea6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a4828682c74cf485ec8e5c1c2b20a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b785435a-7f90-49b8-b4ec-b94536c2b25c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:26Z,use_quota=True,user_id='9efe7f441b534585adab7804501a3198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a292b7f7-caa6-46ad-9325-bafcd9ff64b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a292b7f7-caa6-46ad-9325-bafcd9ff64b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16f51c6-22ad-4dfa-9088-3eed1a432642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16f51c6-22ad-4dfa-9088-3eed1a432642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c09f6fde-285c-4a35-8df9-10984d8bea6e', 'volume_name': 'volume-c09f6fde-285c-4a35-8df9-10984d8bea6e', 'volume_size': 1, 'snapshot_id': 'b785435a-7f90-49b8-b4ec-b94536c2b25c'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed39a21-2ebd-4be8-94b9-43845d283be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed39a21-2ebd-4be8-94b9-43845d283be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2386a464-05ba-4e04-ae32-7779861bf734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:25 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Volume c09f6fde-285c-4a35-8df9-10984d8bea6e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c09f6fde-285c-4a35-8df9-10984d8bea6e', 'volume_size': 1, 'snapshot_id': 'b785435a-7f90-49b8-b4ec-b94536c2b25c'} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-quobyte-b785435a-7f90-49b8-b4ec-b94536c2b25c-c09f6fde-285c-4a35-8df9-10984d8bea6e" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-b785435a-7f90-49b8-b4ec-b94536c2b25c-c09f6fde-285c-4a35-8df9-10984d8bea6e" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Creating volume c09f6fde-285c-4a35-8df9-10984d8bea6e from snapshot b785435a-7f90-49b8-b4ec-b94536c2b25c {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-quobyte-c09f6fde-285c-4a35-8df9-10984d8bea6e" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-c09f6fde-285c-4a35-8df9-10984d8bea6e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] snapshot: b785435a-7f90-49b8-b4ec-b94536c2b25c, volume: c09f6fde-285c-4a35-8df9-10984d8bea6e, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6422e5-0da6-4e3a-86cb-75008a340fb5]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:25 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c Sep 28 12:31:25 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:26 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c" returned: 0 in 0.418s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[50960fc2-c828-4244-a9db-41d9af56495b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:26 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 Sep 28 12:31:26 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:26 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" returned: 0 in 0.391s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:31:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:26 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e Sep 28 12:31:26 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:35 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e" returned: 0 in 8.689s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7, size 1024.00 MB, duration 8.69 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:31:35 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Converted 1024.00 MB image at 117.83 MB/s Sep 28 12:31:35 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e is being set with open permissions: ugo+rw Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:35 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e Sep 28 12:31:35 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:31:35 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e" returned: 0 in 0.301s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-c09f6fde-285c-4a35-8df9-10984d8bea6e" released by "_copy_volume_from_snapshot" :: held 9.895s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-b785435a-7f90-49b8-b4ec-b94536c2b25c-c09f6fde-285c-4a35-8df9-10984d8bea6e" released by "_create_volume_from_snapshot" :: held 9.970s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.994s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2386a464-05ba-4e04-ae32-7779861bf734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09f6fde-285c-4a35-8df9-10984d8bea6e', 'volume_size': 1, 'snapshot_id': 'b785435a-7f90-49b8-b4ec-b94536c2b25c'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d1ace2-4177-44dc-84e7-6b393e8cc499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:35 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Volume volume-c09f6fde-285c-4a35-8df9-10984d8bea6e (c09f6fde-285c-4a35-8df9-10984d8bea6e): created successfully Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d1ace2-4177-44dc-84e7-6b393e8cc499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:35 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Flow 'volume_create_manager' (ad238fc6-082c-4a48-82f9-339ea26e25cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5fa039ad-7b59-4a31-b73e-661254927990 tempest-TestStampPattern-218470353 None] Created volume successfully. Sep 28 12:31:45 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:31:45 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:49 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:31:49 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:49 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.294s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:31:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:32:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-dc751faa-bb50-4e20-accc-5f51fc91ec07 req-6d3b88b5-322b-4b8b-80be-bd20b3c118be tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-dc751faa-bb50-4e20-accc-5f51fc91ec07 req-6d3b88b5-322b-4b8b-80be-bd20b3c118be tempest-TestStampPattern-218470353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [req-dc751faa-bb50-4e20-accc-5f51fc91ec07 req-6d3b88b5-322b-4b8b-80be-bd20b3c118be tempest-TestStampPattern-218470353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-dc751faa-bb50-4e20-accc-5f51fc91ec07 req-6d3b88b5-322b-4b8b-80be-bd20b3c118be tempest-TestStampPattern-218470353 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe', 'name': 'volume-c09f6fde-285c-4a35-8df9-10984d8bea6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70f12619-9741-4457-a57d-6a13d574935c', 'enforce_multipath': True} {{(pid=87167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:32:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-dc751faa-bb50-4e20-accc-5f51fc91ec07 req-6d3b88b5-322b-4b8b-80be-bd20b3c118be tempest-TestStampPattern-218470353 None] attachment_update completed successfully. Sep 28 12:32:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [req-b2edba72-2e46-418a-bcd8-548f6d0bf57f req-34a02601-ebb9-4272-bb99-ef6f01dee8cc tempest-TestStampPattern-218470353 None] Terminate volume connection completed successfully. Sep 28 12:32:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [req-b2edba72-2e46-418a-bcd8-548f6d0bf57f req-34a02601-ebb9-4272-bb99-ef6f01dee8cc tempest-TestStampPattern-218470353 None] Deleting attachment 70f12619-9741-4457-a57d-6a13d574935c. {{(pid=87167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:32:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-c09f6fde-285c-4a35-8df9-10984d8bea6e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Lock "cinder-c09f6fde-285c-4a35-8df9-10984d8bea6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-quobyte-c09f6fde-285c-4a35-8df9-10984d8bea6e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-c09f6fde-285c-4a35-8df9-10984d8bea6e" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[283f00d1-27e8-46cc-8756-7a815db13c4b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:24 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e Sep 28 12:32:24 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:25 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e" returned: 0 in 0.361s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:25 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e Sep 28 12:32:25 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:25 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c09f6fde-285c-4a35-8df9-10984d8bea6e" returned: 0 in 0.242s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-c09f6fde-285c-4a35-8df9-10984d8bea6e" released by "delete_volume" :: held 0.650s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Created reservations ['5b010bc2-07d9-496a-af18-e630fc29d6fe', 'efb5a855-3d92-4377-9c13-af163880958a', '1a4e9b80-c14e-422f-8663-cb7076ad53ac', '2565cd87-2527-4e64-881c-4bddc372c1dd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:25 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:32:25 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:25 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.253s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Deleted volume successfully. Sep 28 12:32:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b6bd379c-145c-468f-a40f-70dd5125ce0d tempest-TestStampPattern-218470353 None] Lock "cinder-c09f6fde-285c-4a35-8df9-10984d8bea6e-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-b785435a-7f90-49b8-b4ec-b94536c2b25c-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Lock "cinder-b785435a-7f90-49b8-b4ec-b94536c2b25c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-quobyte-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-quobyte-b785435a-7f90-49b8-b4ec-b94536c2b25c" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-b785435a-7f90-49b8-b4ec-b94536c2b25c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Deleting offline snapshot b785435a-7f90-49b8-b4ec-b94536c2b25c of volume 8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] snapshot_file for this snap is: volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e33a3ab-2337-439a-9da9-1ba117f1e96e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:26 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c Sep 28 12:32:26 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:26 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c" returned: 0 in 0.352s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf05e1cc-9d98-4c92-8602-8e09cc2c4d59]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:26 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 Sep 28 12:32:26 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:27 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" returned: 0 in 0.570s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:27 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c Sep 28 12:32:27 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:27 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c" returned: 0 in 0.327s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:27 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c Sep 28 12:32:27 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:27 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7.b785435a-7f90-49b8-b4ec-b94536c2b25c" returned: 0 in 0.249s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-b785435a-7f90-49b8-b4ec-b94536c2b25c" released by "_delete_snapshot" :: held 1.621s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" released by "delete_snapshot" :: held 1.645s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Created reservations ['c3fcc9e7-1be2-4c2a-a7dc-4c9605734944', 'fa0c4e01-7926-4c20-bf8a-07c01c41ee7b', 'd4a59013-e60f-44ed-ace0-7533f4b01774', '5b9ddde1-f9c4-48e7-85f7-b066458425e7'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Delete snapshot completed successfully. Sep 28 12:32:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d994cda3-2c12-4f25-ae45-99443cffa78b tempest-TestStampPattern-218470353 None] Lock "cinder-b785435a-7f90-49b8-b4ec-b94536c2b25c-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-8734cd5f-614b-4f60-aba0-dbe7f3a123e7-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Lock "cinder-8734cd5f-614b-4f60-aba0-dbe7f3a123e7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Acquiring lock "cinder-quobyte-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d2c3e-380e-4b2c-8ed4-6f4864ea8cf3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:32 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 Sep 28 12:32:32 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:32 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" returned: 0 in 0.356s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:32 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7 Sep 28 12:32:32 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:32 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" returned: 0 in 0.242s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Lock "cinder-quobyte-8734cd5f-614b-4f60-aba0-dbe7f3a123e7" released by "delete_volume" :: held 0.660s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Created reservations ['4c2dd2a0-b5f2-44c2-bc05-46b271956790', '04a3ecd7-4909-46b3-b7f2-d5f6b5671027', '2ff27812-9a1d-416b-8806-20ec87266417', 'b79b709b-c745-4bc4-8cde-ccc353ccece1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:32 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:32:32 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:32 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.260s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:32 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Deleted volume successfully. Sep 28 12:32:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8b41d0c1-4ca5-403a-9dd2-01f504fbfc30 tempest-TestStampPattern-218470353 None] Lock "cinder-8734cd5f-614b-4f60-aba0-dbe7f3a123e7-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:42 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:32:42 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:49 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:32:49 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:49 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.256s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:32:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Flow 'volume_create_manager' (f09a4d2c-9270-45dd-9835-98b7eb9af21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbd1170-056e-4e2b-ac8a-25fcdc988ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbd1170-056e-4e2b-ac8a-25fcdc988ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-860627584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b83124-47d8-4423-99e8-ecca07e3cccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d78a215c78646e9a0e5f8c3bc87c5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:10Z,use_quota=True,user_id='0d0ec6593acc42de87d0f6b7a6b3b071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedd6200-16cd-4f9a-95c2-e4f2057fa4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedd6200-16cd-4f9a-95c2-e4f2057fa4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce70d62a-2c33-41e2-b6e7-86afbc96c131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce70d62a-2c33-41e2-b6e7-86afbc96c131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b83124-47d8-4423-99e8-ecca07e3cccd', 'volume_name': 'volume-a0b83124-47d8-4423-99e8-ecca07e3cccd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3221b72b-d97c-46ff-b602-21eb6fed5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3221b72b-d97c-46ff-b602-21eb6fed5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542735ab-2962-404a-8de9-8f756632267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Volume a0b83124-47d8-4423-99e8-ecca07e3cccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b83124-47d8-4423-99e8-ecca07e3cccd', 'volume_size': 1} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-860627584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b83124-47d8-4423-99e8-ecca07e3cccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d78a215c78646e9a0e5f8c3bc87c5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:10Z,use_quota=True,user_id='0d0ec6593acc42de87d0f6b7a6b3b071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Creating volume a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:09 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:09 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd 1073741824 Sep 28 12:33:09 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:10 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd 1073741824" returned: 0 in 0.430s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:10 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd Sep 28 12:33:10 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:10 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd" returned: 0 in 0.245s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542735ab-2962-404a-8de9-8f756632267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b83124-47d8-4423-99e8-ecca07e3cccd', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece77510-e771-4c91-a3ed-39f1b5d187f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Volume volume-a0b83124-47d8-4423-99e8-ecca07e3cccd (a0b83124-47d8-4423-99e8-ecca07e3cccd): created successfully Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece77510-e771-4c91-a3ed-39f1b5d187f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Flow 'volume_create_manager' (f09a4d2c-9270-45dd-9835-98b7eb9af21e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:10 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bfc08f79-86d9-40aa-8c1a-62b2867ad3bf tempest-SnapshotDependencyTests-2082184722 None] Created volume successfully. Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Creating offline snapshot 287edcba-9e04-4cee-b669-da3728100085 of volume a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7312df-6674-4371-bff3-bf9058119c5f]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:11 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd Sep 28 12:33:11 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:11 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd" returned: 0 in 0.356s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:11 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 1G Sep 28 12:33:11 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:11 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 1G" returned: 0 in 0.387s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0b83124-47d8-4423-99e8-ecca07e3cccd -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:11 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0b83124-47d8-4423-99e8-ecca07e3cccd -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 Sep 28 12:33:11 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:11 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0b83124-47d8-4423-99e8-ecca07e3cccd -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085" returned: 0 in 0.297s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:11 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 is being set with open permissions: ugo+rw Sep 28 12:33:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:12 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 Sep 28 12:33:12 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:12 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085" returned: 0 in 0.237s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:12 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.info Sep 28 12:33:12 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:12 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.info" returned: 0 in 0.246s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:12 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.info is being set with open permissions: ugo+rw Sep 28 12:33:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:12 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.info Sep 28 12:33:12 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:12 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.info" returned: 0 in 0.255s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3d847aee-32ed-4fb9-b4fe-16e39a216b8c tempest-SnapshotDependencyTests-2082184722 None] Create snapshot completed successfully Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Flow 'volume_create_manager' (e2548eaa-1994-42c7-8990-72e24ca4d960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1789caa-23e7-4488-a812-c664356cec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1789caa-23e7-4488-a812-c664356cec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599c22b9-02c9-432f-b253-dc71cfbfefa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d78a215c78646e9a0e5f8c3bc87c5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=287edcba-9e04-4cee-b669-da3728100085,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:14Z,use_quota=True,user_id='0d0ec6593acc42de87d0f6b7a6b3b071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7c8382-b8b3-43f8-8e2a-25ce30d1f80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7c8382-b8b3-43f8-8e2a-25ce30d1f80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a5dbf4-d4b3-4e46-a4bf-eae9f6ff0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a5dbf4-d4b3-4e46-a4bf-eae9f6ff0e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '599c22b9-02c9-432f-b253-dc71cfbfefa0', 'volume_name': 'volume-599c22b9-02c9-432f-b253-dc71cfbfefa0', 'volume_size': 1, 'snapshot_id': '287edcba-9e04-4cee-b669-da3728100085'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c390b1d6-bbce-4ef4-9768-ce034401a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c390b1d6-bbce-4ef4-9768-ce034401a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de3a533-2501-407a-99ed-2658728401f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Volume 599c22b9-02c9-432f-b253-dc71cfbfefa0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-599c22b9-02c9-432f-b253-dc71cfbfefa0', 'volume_size': 1, 'snapshot_id': '287edcba-9e04-4cee-b669-da3728100085'} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-quobyte-287edcba-9e04-4cee-b669-da3728100085-599c22b9-02c9-432f-b253-dc71cfbfefa0" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-287edcba-9e04-4cee-b669-da3728100085-599c22b9-02c9-432f-b253-dc71cfbfefa0" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Creating volume 599c22b9-02c9-432f-b253-dc71cfbfefa0 from snapshot 287edcba-9e04-4cee-b669-da3728100085 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-quobyte-599c22b9-02c9-432f-b253-dc71cfbfefa0" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-599c22b9-02c9-432f-b253-dc71cfbfefa0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] snapshot: 287edcba-9e04-4cee-b669-da3728100085, volume: 599c22b9-02c9-432f-b253-dc71cfbfefa0, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec60f414-8176-4a88-88ce-87cef79acb88]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:13 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 Sep 28 12:33:13 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:14 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085" returned: 0 in 0.367s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0b83124-47d8-4423-99e8-ecca07e3cccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d414d6ca-b866-4f92-a856-97a534e61c59]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:14 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd Sep 28 12:33:14 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:14 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd" returned: 0 in 0.385s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:33:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:14 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 Sep 28 12:33:14 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:20 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0" returned: 0 in 5.800s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:33:20 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Converted 1024.00 MB image at 176.51 MB/s Sep 28 12:33:20 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 is being set with open permissions: ugo+rw Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:20 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 Sep 28 12:33:20 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:20 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0" returned: 0 in 0.232s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-599c22b9-02c9-432f-b253-dc71cfbfefa0" released by "_copy_volume_from_snapshot" :: held 6.868s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-287edcba-9e04-4cee-b669-da3728100085-599c22b9-02c9-432f-b253-dc71cfbfefa0" released by "_create_volume_from_snapshot" :: held 6.930s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.946s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de3a533-2501-407a-99ed-2658728401f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599c22b9-02c9-432f-b253-dc71cfbfefa0', 'volume_size': 1, 'snapshot_id': '287edcba-9e04-4cee-b669-da3728100085'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0affa4-147f-4b88-8be0-c27272adbe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Volume volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 (599c22b9-02c9-432f-b253-dc71cfbfefa0): created successfully Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0affa4-147f-4b88-8be0-c27272adbe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Flow 'volume_create_manager' (e2548eaa-1994-42c7-8990-72e24ca4d960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e2035ba1-7367-484f-8cf4-b802e5bbbc55 tempest-SnapshotDependencyTests-2082184722 None] Created volume successfully. Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-287edcba-9e04-4cee-b669-da3728100085-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-287edcba-9e04-4cee-b669-da3728100085-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-quobyte-a0b83124-47d8-4423-99e8-ecca07e3cccd" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-a0b83124-47d8-4423-99e8-ecca07e3cccd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-quobyte-287edcba-9e04-4cee-b669-da3728100085" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-287edcba-9e04-4cee-b669-da3728100085" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Deleting offline snapshot 287edcba-9e04-4cee-b669-da3728100085 of volume a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] snapshot_file for this snap is: volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3764e2-04ce-4a89-8eb7-e13ea56eacc2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:21 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 Sep 28 12:33:21 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:21 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085" returned: 0 in 0.340s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0b83124-47d8-4423-99e8-ecca07e3cccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfb85b2-e91b-43cf-8e72-3dd3b6ba9e6f]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:21 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd Sep 28 12:33:21 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:22 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd" returned: 0 in 0.528s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:22 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 Sep 28 12:33:22 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:22 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085" returned: 0 in 0.315s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:22 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085 Sep 28 12:33:22 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:22 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd.287edcba-9e04-4cee-b669-da3728100085" returned: 0 in 0.244s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-287edcba-9e04-4cee-b669-da3728100085" released by "_delete_snapshot" :: held 1.533s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-a0b83124-47d8-4423-99e8-ecca07e3cccd" released by "delete_snapshot" :: held 1.554s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Created reservations ['0ca1a162-8054-4c76-98c7-c81067648b93', '372016fe-8746-409e-aff7-d83b06f6db3b', 'f7f4e449-620b-4f53-8fd2-49754b92ea96', '5cb3595a-82f0-4a92-9474-b165deeb3ddd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Delete snapshot completed successfully. Sep 28 12:33:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b553fe40-a243-4a81-b13b-06294cc2938b tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-287edcba-9e04-4cee-b669-da3728100085-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-a0b83124-47d8-4423-99e8-ecca07e3cccd-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-a0b83124-47d8-4423-99e8-ecca07e3cccd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-quobyte-a0b83124-47d8-4423-99e8-ecca07e3cccd" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-a0b83124-47d8-4423-99e8-ecca07e3cccd" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae46445b-ca55-41ab-b486-753de3f7902d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:23 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd Sep 28 12:33:23 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:23 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd" returned: 0 in 0.381s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:23 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd Sep 28 12:33:23 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:24 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a0b83124-47d8-4423-99e8-ecca07e3cccd" returned: 0 in 0.245s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-a0b83124-47d8-4423-99e8-ecca07e3cccd" released by "delete_volume" :: held 0.686s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Created reservations ['f1d7d3c3-3212-4a5b-acc3-c7068353912f', 'bce22792-6c7a-42d5-ae57-0afbe9884adc', 'bfc31f90-f393-4701-afb7-3a77a7bf36eb', '2d5f70b5-50a0-4167-8065-6c571536de88'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:24 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:33:24 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:24 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.242s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Deleted volume successfully. Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-460e55ad-fccf-44fc-b4ab-1ac68e2a74f0 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-a0b83124-47d8-4423-99e8-ecca07e3cccd-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-599c22b9-02c9-432f-b253-dc71cfbfefa0-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-599c22b9-02c9-432f-b253-dc71cfbfefa0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "cinder-quobyte-599c22b9-02c9-432f-b253-dc71cfbfefa0" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-599c22b9-02c9-432f-b253-dc71cfbfefa0" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9d668-449e-4047-a982-e503ebcf42e3]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:24 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 Sep 28 12:33:24 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:24 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0" returned: 0 in 0.367s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:25 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0 Sep 28 12:33:25 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:25 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-599c22b9-02c9-432f-b253-dc71cfbfefa0" returned: 0 in 0.240s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-quobyte-599c22b9-02c9-432f-b253-dc71cfbfefa0" released by "delete_volume" :: held 0.650s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Created reservations ['82e6e1a8-0746-44b8-abea-64a17aede7e4', '47309327-8ab5-4f85-86ab-e0bb2a812d6b', '1071ceec-e3b8-4cdc-91fd-a8974d79aff5', '92855f6c-cc99-42e4-b1f9-ca70ea127696'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:25 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:33:25 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:25 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.254s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Deleted volume successfully. Sep 28 12:33:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-11eb9242-cb09-4549-a86a-dffd4790a617 tempest-SnapshotDependencyTests-2082184722 None] Lock "cinder-599c22b9-02c9-432f-b253-dc71cfbfefa0-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:35 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=27,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:33:35 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=29,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (beb4f6cb-c9ea-46b0-bfdb-07bfc48f6e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b96c00-3f44-4800-a3b2-5ca87b104979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (a995d8a5-9363-4db7-a5b6-dbb268462c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07977f17-c0ca-4da4-b626-0f6fdc44c0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b96c00-3f44-4800-a3b2-5ca87b104979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155057150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5102886e-2fec-4fbd-9611-0c1af1872aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:46Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2497ef-f12a-4244-a5f3-3e328d29fe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2497ef-f12a-4244-a5f3-3e328d29fe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18663561-9973-4327-8a9a-b86c2c4eaf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18663561-9973-4327-8a9a-b86c2c4eaf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5102886e-2fec-4fbd-9611-0c1af1872aec', 'volume_name': 'volume-5102886e-2fec-4fbd-9611-0c1af1872aec', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23ad4ac-e867-4cf9-aa59-f79a666cf371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23ad4ac-e867-4cf9-aa59-f79a666cf371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b132a6ee-aefb-4b18-af10-c2d895da0fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Volume 5102886e-2fec-4fbd-9611-0c1af1872aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5102886e-2fec-4fbd-9611-0c1af1872aec', 'volume_size': 1} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155057150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5102886e-2fec-4fbd-9611-0c1af1872aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:46Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Creating volume 5102886e-2fec-4fbd-9611-0c1af1872aec {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:46 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07977f17-c0ca-4da4-b626-0f6fdc44c0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754817450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea8b6c5-0e50-4039-8a03-dc1950743840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:46Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75487ab8-b41b-40ee-b216-dd686e40ad53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec 1073741824 Sep 28 12:33:46 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75487ab8-b41b-40ee-b216-dd686e40ad53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdc5c51-4262-4e92-8b18-2cf93b0db2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdc5c51-4262-4e92-8b18-2cf93b0db2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea8b6c5-0e50-4039-8a03-dc1950743840', 'volume_name': 'volume-1ea8b6c5-0e50-4039-8a03-dc1950743840', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb66125-088b-4620-8183-b048a1001069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb66125-088b-4620-8183-b048a1001069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6fcc7a-49ca-4112-b8f7-9305fc485284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume 1ea8b6c5-0e50-4039-8a03-dc1950743840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea8b6c5-0e50-4039-8a03-dc1950743840', 'volume_size': 1} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (f0cf15fc-30ef-468f-9336-6fc731bdfec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476d83fc-4d41-4553-8b70-3a416aec335a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476d83fc-4d41-4553-8b70-3a416aec335a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695753681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a89570b-c603-4b25-a839-6026ae8e661d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:46Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ec7bc5-0032-4c8e-88d9-d9b0a6519100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ec7bc5-0032-4c8e-88d9-d9b0a6519100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011eb0fd-e77d-4f14-b979-c295ef998f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011eb0fd-e77d-4f14-b979-c295ef998f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a89570b-c603-4b25-a839-6026ae8e661d', 'volume_name': 'volume-2a89570b-c603-4b25-a839-6026ae8e661d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bf8df6-e057-4286-bd3b-09531379dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bf8df6-e057-4286-bd3b-09531379dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c57526-f359-4702-837c-604bf792c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Volume 2a89570b-c603-4b25-a839-6026ae8e661d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a89570b-c603-4b25-a839-6026ae8e661d', 'volume_size': 1} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9e1f08fd-ef3b-4dff-8fbe-e1e6f770dff8 tempest-ProjectAdminTests-1859142791 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.200527191162, 'free_capacity_gb': 1775.200527191162, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 12:33:46 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (b1bff5a4-8ad5-40d3-91ce-afda697b09db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a456e910-2a29-4dd1-8d5a-f91b39f9728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a456e910-2a29-4dd1-8d5a-f91b39f9728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408593290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c13cd6f-fbc5-45cc-8f94-08f9596421b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:47Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dee53d-fbc0-4aee-b382-b683addd265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dee53d-fbc0-4aee-b382-b683addd265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89948459-ce77-4f82-bd4b-11f23b1ea9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89948459-ce77-4f82-bd4b-11f23b1ea9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c13cd6f-fbc5-45cc-8f94-08f9596421b2', 'volume_name': 'volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089f8e96-0e94-477f-a3a0-0e91efed89cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089f8e96-0e94-477f-a3a0-0e91efed89cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f70fda7-8909-4a86-a551-c45a5e602437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Volume 3c13cd6f-fbc5-45cc-8f94-08f9596421b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2', 'volume_size': 1} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:47 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec 1073741824" returned: 0 in 0.767s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:47 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec Sep 28 12:33:47 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (78943b03-c3e3-4ec6-aea7-b9f4e916a74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc73ec1-d730-4c91-b789-c0d60c68c346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc73ec1-d730-4c91-b789-c0d60c68c346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1373447954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ae9f1d-a962-45e1-bf73-0a23ac90dc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:47Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4c2358-00ce-403a-8b2d-6fa6c1487655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4c2358-00ce-403a-8b2d-6fa6c1487655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b99664-41c2-4fac-bc8d-688eeec06d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b99664-41c2-4fac-bc8d-688eeec06d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ae9f1d-a962-45e1-bf73-0a23ac90dc22', 'volume_name': 'volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8557a4cd-8b77-424b-90fb-5b68ee8f78c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8557a4cd-8b77-424b-90fb-5b68ee8f78c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68e7bf7-321e-4f99-84d4-1acd40141328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Volume 97ae9f1d-a962-45e1-bf73-0a23ac90dc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22', 'volume_size': 1} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:47 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec" returned: 0 in 0.393s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754817450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea8b6c5-0e50-4039-8a03-dc1950743840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:46Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Creating volume 1ea8b6c5-0e50-4039-8a03-dc1950743840 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:47 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:47 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 1073741824 Sep 28 12:33:47 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b132a6ee-aefb-4b18-af10-c2d895da0fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5102886e-2fec-4fbd-9611-0c1af1872aec', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99780e8-b393-4ff1-85c5-5f72f0f06a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Volume volume-5102886e-2fec-4fbd-9611-0c1af1872aec (5102886e-2fec-4fbd-9611-0c1af1872aec): created successfully Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99780e8-b393-4ff1-85c5-5f72f0f06a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (beb4f6cb-c9ea-46b0-bfdb-07bfc48f6e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (934c732d-f2d2-4438-9f3a-15b23546d530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5271cbae-6be4-4be8-b01f-e14741802076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3e817da7-7ce4-4927-92ce-9a4034a559a5 tempest-CreateVolumesFromImageTest-797939417 None] Created volume successfully. Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5271cbae-6be4-4be8-b01f-e14741802076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1314031963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89ad190-fa40-48bb-a177-27142c73e748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:48Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b1e146-baf3-486c-be60-f10637dbba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b1e146-baf3-486c-be60-f10637dbba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdee3b51-3f67-41ea-878e-7d5d1cc5a82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdee3b51-3f67-41ea-878e-7d5d1cc5a82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89ad190-fa40-48bb-a177-27142c73e748', 'volume_name': 'volume-f89ad190-fa40-48bb-a177-27142c73e748', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db411680-0552-49f9-ba7f-8da92df1bd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db411680-0552-49f9-ba7f-8da92df1bd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bcce01e-31e9-4692-9df0-7dff73c13a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Volume f89ad190-fa40-48bb-a177-27142c73e748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89ad190-fa40-48bb-a177-27142c73e748', 'volume_size': 1} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:48 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 1073741824" returned: 0 in 0.549s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:48 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 Sep 28 12:33:48 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:48 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840" returned: 0 in 0.310s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695753681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a89570b-c603-4b25-a839-6026ae8e661d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:46Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Creating volume 2a89570b-c603-4b25-a839-6026ae8e661d {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:48 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:48 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d 1073741824 Sep 28 12:33:48 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6fcc7a-49ca-4112-b8f7-9305fc485284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea8b6c5-0e50-4039-8a03-dc1950743840', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6b9c16-fa13-44d4-8169-60e0c76c0e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 (1ea8b6c5-0e50-4039-8a03-dc1950743840): created successfully Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6b9c16-fa13-44d4-8169-60e0c76c0e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (a995d8a5-9363-4db7-a5b6-dbb268462c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8450ae2b-33d1-4bac-959c-175bd16d6f19 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created volume successfully. Sep 28 12:33:49 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d 1073741824" returned: 0 in 0.655s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:49 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d Sep 28 12:33:49 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:49 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:33:49 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:49 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d" returned: 0 in 0.290s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408593290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c13cd6f-fbc5-45cc-8f94-08f9596421b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:47Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Creating volume 3c13cd6f-fbc5-45cc-8f94-08f9596421b2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c57526-f359-4702-837c-604bf792c400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a89570b-c603-4b25-a839-6026ae8e661d', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:49 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 1073741824 Sep 28 12:33:49 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91012cb1-ff1b-4059-a81e-4cce0a892e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:49 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Volume volume-2a89570b-c603-4b25-a839-6026ae8e661d (2a89570b-c603-4b25-a839-6026ae8e661d): created successfully Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91012cb1-ff1b-4059-a81e-4cce0a892e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (f0cf15fc-30ef-468f-9336-6fc731bdfec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:49 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-71ed7384-942e-489b-8c76-31c54149ea96 tempest-CreateVolumesFromImageTest-797939417 None] Created volume successfully. Sep 28 12:33:49 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.363s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:33:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:33:50 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 1073741824" returned: 0 in 0.590s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:50 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 Sep 28 12:33:50 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:50 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2" returned: 0 in 0.277s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.029s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1373447954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ae9f1d-a962-45e1-bf73-0a23ac90dc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:47Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Creating volume 97ae9f1d-a962-45e1-bf73-0a23ac90dc22 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:50 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f70fda7-8909-4a86-a551-c45a5e602437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:50 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 1073741824 Sep 28 12:33:50 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e43613-4a95-450c-8679-684dd914803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Volume volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 (3c13cd6f-fbc5-45cc-8f94-08f9596421b2): created successfully Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e43613-4a95-450c-8679-684dd914803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (b1bff5a4-8ad5-40d3-91ce-afda697b09db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-abd6c5aa-7f06-4745-a2c1-47a96a45a0d6 tempest-CreateVolumesFromImageTest-797939417 None] Created volume successfully. Sep 28 12:33:51 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 1073741824" returned: 0 in 0.590s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:51 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 Sep 28 12:33:51 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Flow 'volume_create_manager' (dd56b48a-ced3-41dc-87de-31e0ca99f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623774d6-9b3c-4b84-8a28-7df7948b0104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623774d6-9b3c-4b84-8a28-7df7948b0104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca549e0-b544-4338-9617-37b6f1fedfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06038e006c84390bd520a18e125d02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:51Z,use_quota=True,user_id='37d1482ca0db45abb1606569c818b19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf93713-be0e-4c32-a462-919831d0a3d1),volume_type_id=daf93713-be0e-4c32-a462-919831d0a3d1)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d55b77-606f-4e9c-8ba0-7c2432d50e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d55b77-606f-4e9c-8ba0-7c2432d50e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671c7f78-6b50-472c-9c11-e53994e9f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:33:51 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.436s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1314031963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89ad190-fa40-48bb-a177-27142c73e748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bb7c1dc17b54bce9d1aaa4958509692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:48Z,use_quota=True,user_id='7a7f6da8e5bb4082885b2a9fddb34dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Creating volume f89ad190-fa40-48bb-a177-27142c73e748 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:51 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68e7bf7-321e-4f99-84d4-1acd40141328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 1073741824 Sep 28 12:33:51 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995c8f55-2000-4d3f-9ba3-c5344fdb62b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Volume volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 (97ae9f1d-a962-45e1-bf73-0a23ac90dc22): created successfully Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995c8f55-2000-4d3f-9ba3-c5344fdb62b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (78943b03-c3e3-4ec6-aea7-b9f4e916a74a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c7b18060-4502-443e-a851-b5442ccabc53 tempest-CreateVolumesFromImageTest-797939417 None] Created volume successfully. Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671c7f78-6b50-472c-9c11-e53994e9f901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ca549e0-b544-4338-9617-37b6f1fedfad', 'volume_name': 'volume-6ca549e0-b544-4338-9617-37b6f1fedfad', 'volume_size': 1, 'image_id': '5495960c-f8cc-485d-8ba9-3625955eb64b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5495960c-f8cc-485d-8ba9-3625955eb64b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74b9c8b8147a2b6ec5c658c9e7bc1814', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b06038e006c84390bd520a18e125d02e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f46f2f6fba1a594fe6d9c2783af8fee480cbf5ec740e92873f5191e6d5616bd8dcf669ecc0101eb3e8f591bc6ff6c48a4312b73340e42446ae21cdd73c2dc56', 'id': '5495960c-f8cc-485d-8ba9-3625955eb64b', 'created_at': datetime.datetime(2026, 9, 28, 10, 33, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 33, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5495960c-f8cc-485d-8ba9-3625955eb64b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bcadda-2511-4e50-96e2-2e7ed0901792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0bcadda-2511-4e50-96e2-2e7ed0901792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff65a75-35d4-499a-8100-056968f9cd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Volume 6ca549e0-b544-4338-9617-37b6f1fedfad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ca549e0-b544-4338-9617-37b6f1fedfad', 'volume_size': 1, 'image_id': '5495960c-f8cc-485d-8ba9-3625955eb64b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5495960c-f8cc-485d-8ba9-3625955eb64b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74b9c8b8147a2b6ec5c658c9e7bc1814', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b06038e006c84390bd520a18e125d02e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f46f2f6fba1a594fe6d9c2783af8fee480cbf5ec740e92873f5191e6d5616bd8dcf669ecc0101eb3e8f591bc6ff6c48a4312b73340e42446ae21cdd73c2dc56', 'id': '5495960c-f8cc-485d-8ba9-3625955eb64b', 'created_at': datetime.datetime(2026, 9, 28, 10, 33, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 33, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5495960c-f8cc-485d-8ba9-3625955eb64b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 12:33:51 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Trying to clone 6ca549e0-b544-4338-9617-37b6f1fedfad from image 5495960c-f8cc-485d-8ba9-3625955eb64b at location (None, [{'url': 'file:///opt/stack/data/glance/images/5495960c-f8cc-485d-8ba9-3625955eb64b', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (1e2530f2-02db-4d12-90e0-ae7e026966a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38f1393-c98d-4857-9898-347953a993e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38f1393-c98d-4857-9898-347953a993e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835687150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0797f996-3062-43bb-9426-13e18852b7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:52Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3d03c1-d19f-4040-ae6b-68995c417c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3d03c1-d19f-4040-ae6b-68995c417c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46947dd-b864-44f7-8e1a-f4d22fc26871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46947dd-b864-44f7-8e1a-f4d22fc26871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0797f996-3062-43bb-9426-13e18852b7f6', 'volume_name': 'volume-0797f996-3062-43bb-9426-13e18852b7f6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7da117-8bb4-4a47-aa19-e335a5114b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7da117-8bb4-4a47-aa19-e335a5114b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779e1b09-253d-4322-9488-549e28403df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:52 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Volume 0797f996-3062-43bb-9426-13e18852b7f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0797f996-3062-43bb-9426-13e18852b7f6', 'volume_size': 1} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:33:52 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:33:52 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 1073741824" returned: 0 in 0.582s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4b2a47-5891-408e-886e-9693a8e56099]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:52 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 Sep 28 12:33:52 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:52 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD Sep 28 12:33:52 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:52 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748" returned: 0 in 0.274s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bcce01e-31e9-4692-9df0-7dff73c13a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89ad190-fa40-48bb-a177-27142c73e748', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385b79c8-7180-43ad-a22d-dc9048366376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Creating offline snapshot aca2ab98-0dfa-4060-a0e3-6de21c0042cb of volume 1ea8b6c5-0e50-4039-8a03-dc1950743840 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:33:52 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Volume volume-f89ad190-fa40-48bb-a177-27142c73e748 (f89ad190-fa40-48bb-a177-27142c73e748): created successfully Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385b79c8-7180-43ad-a22d-dc9048366376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Flow 'volume_create_manager' (934c732d-f2d2-4438-9f3a-15b23546d530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[684ce741-4249-4079-a950-90cab545f058]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:52 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:52 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-84efd70b-3bea-4840-b029-d690f095d4c0 tempest-CreateVolumesFromImageTest-797939417 None] Created volume successfully. Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:52 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 Sep 28 12:33:52 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:52 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD Sep 28 12:33:52 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:52 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:52 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840" returned: 0 in 0.387s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:33:52 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Temporary image 5495960c-f8cc-485d-8ba9-3625955eb64b is fetched for user 37d1482ca0db45abb1606569c818b19f. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:33:52 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb 1G Sep 28 12:33:52 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e712cdf6-840f-4e8e-8f00-05bc9b5ec29d]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD Sep 28 12:33:53 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb 1G" returned: 0 in 0.463s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-f89ad190-fa40-48bb-a177-27142c73e748-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:53 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb Sep 28 12:33:53 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-f89ad190-fa40-48bb-a177-27142c73e748-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:53 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD Sep 28 12:33:53 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-quobyte-f89ad190-fa40-48bb-a177-27142c73e748" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-f89ad190-fa40-48bb-a177-27142c73e748" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2766551-1469-4e17-8b93-88341e3be206]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 Sep 28 12:33:53 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:53 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb" returned: 0 in 0.357s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb is being set with open permissions: ugo+rw Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb Sep 28 12:33:53 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748" returned: 0 in 0.425s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:54 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:54 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748 Sep 28 12:33:54 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb" returned: 0 in 0.258s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:54 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.info Sep 28 12:33:54 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:54 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f89ad190-fa40-48bb-a177-27142c73e748" returned: 0 in 0.259s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-f89ad190-fa40-48bb-a177-27142c73e748" released by "delete_volume" :: held 0.740s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:54 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.info" returned: 0 in 0.276s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:54 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.info is being set with open permissions: ugo+rw Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Created reservations ['31603dc8-2a0e-402f-b2b4-ae411002cb11', 'ba9a9672-e360-4510-8955-c8f9dd9155f8', '91077d59-38cb-44aa-9b87-ec4d399db0d1', '669514c2-91e1-476b-acba-5ab627d2714a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:54 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.info Sep 28 12:33:54 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:54 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:33:54 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-97ae9f1d-a962-45e1-bf73-0a23ac90dc22-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:54 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.info" returned: 0 in 0.280s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-97ae9f1d-a962-45e1-bf73-0a23ac90dc22-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.531s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835687150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0797f996-3062-43bb-9426-13e18852b7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:52Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Creating volume 0797f996-3062-43bb-9426-13e18852b7f6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:54 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:54 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 1073741824 Sep 28 12:33:54 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-20fe512f-d1e3-4611-95aa-5dfdde80270b tempest-CreateVolumesFromSnapshotTest-1983480157 None] Create snapshot completed successfully Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-quobyte-97ae9f1d-a962-45e1-bf73-0a23ac90dc22" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:54 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.313s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Deleted volume successfully. Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-97ae9f1d-a962-45e1-bf73-0a23ac90dc22" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab2c434-f954-49a9-bac3-c6f9dfe98b78]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1cec0f91-29f5-412a-9c23-d29e85ad2e61 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-f89ad190-fa40-48bb-a177-27142c73e748-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:54 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 Sep 28 12:33:54 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:55 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 1073741824" returned: 0 in 0.521s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:55 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22" returned: 0 in 0.404s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:55 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22 Sep 28 12:33:55 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:55 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 Sep 28 12:33:55 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:55 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-97ae9f1d-a962-45e1-bf73-0a23ac90dc22" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:55 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-97ae9f1d-a962-45e1-bf73-0a23ac90dc22" released by "delete_volume" :: held 0.748s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca549e0-b544-4338-9617-37b6f1fedfad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06038e006c84390bd520a18e125d02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:51Z,use_quota=True,user_id='37d1482ca0db45abb1606569c818b19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(daf93713-be0e-4c32-a462-919831d0a3d1),volume_type_id=daf93713-be0e-4c32-a462-919831d0a3d1)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Creating volume 6ca549e0-b544-4338-9617-37b6f1fedfad {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:55 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:55 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad 1073741824 Sep 28 12:33:55 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779e1b09-253d-4322-9488-549e28403df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0797f996-3062-43bb-9426-13e18852b7f6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feacae7f-4153-4f91-bcc3-526054f2a44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Volume volume-0797f996-3062-43bb-9426-13e18852b7f6 (0797f996-3062-43bb-9426-13e18852b7f6): created successfully Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feacae7f-4153-4f91-bcc3-526054f2a44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (1e2530f2-02db-4d12-90e0-ae7e026966a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-005e6f83-cc77-452f-9131-90b97e944d3d tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Created reservations ['35b2d770-6d26-422a-8e0c-cc3b2644979c', 'ce21a139-4374-48ce-b879-2123243f4d85', 'c8cea766-6577-46cc-a0e3-5755817368cc', 'b680824e-5471-467a-931a-e1c52c3ebb81'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:55 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:33:55 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-3c13cd6f-fbc5-45cc-8f94-08f9596421b2-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-3c13cd6f-fbc5-45cc-8f94-08f9596421b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-quobyte-3c13cd6f-fbc5-45cc-8f94-08f9596421b2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-3c13cd6f-fbc5-45cc-8f94-08f9596421b2" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e0336d-fca5-4b2a-ac4f-0cb8ad511e7d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:56 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.384s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Deleted volume successfully. Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-88ecd424-0f19-4f64-8009-3ca2828c78de tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-97ae9f1d-a962-45e1-bf73-0a23ac90dc22-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:56 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad 1073741824" returned: 0 in 0.612s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:56 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 Sep 28 12:33:56 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:56 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad Sep 28 12:33:56 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (4b6078af-cfdb-4320-a5d9-8823e9e805a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14ee35b-f77e-4e24-94f7-33532959f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14ee35b-f77e-4e24-94f7-33532959f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957413275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c92b0a-21e2-4f93-95e5-ded9d6fc88b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:56Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d4b187-795b-4bf0-8288-0fe60e682409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d4b187-795b-4bf0-8288-0fe60e682409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416e8ff6-5002-47f0-a62c-b609abb8ff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416e8ff6-5002-47f0-a62c-b609abb8ff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c92b0a-21e2-4f93-95e5-ded9d6fc88b5', 'volume_name': 'volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907a1f45-fb3f-48d6-86a0-87a628bb9575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907a1f45-fb3f-48d6-86a0-87a628bb9575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b20c8e-fc9d-44ce-940c-36d277ff1fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume 86c92b0a-21e2-4f93-95e5-ded9d6fc88b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5', 'volume_size': 1} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2" returned: 0 in 0.572s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:56 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2 Sep 28 12:33:56 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:56 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad" returned: 0 in 0.451s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.109s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957413275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c92b0a-21e2-4f93-95e5-ded9d6fc88b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:56Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Creating volume 86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:56 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:56 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 1073741824 Sep 28 12:33:56 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Attempting download of 5495960c-f8cc-485d-8ba9-3625955eb64b ((None, [{'url': 'file:///opt/stack/data/glance/images/5495960c-f8cc-485d-8ba9-3625955eb64b', 'metadata': {}}])) to volume 6ca549e0-b544-4338-9617-37b6f1fedfad. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff19f4d-96c2-495b-ac16-78089e5dea13]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5495960c-f8cc-485d-8ba9-3625955eb64b_gkmp3uvv {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (bf15edca-6636-4606-8877-5064d495bb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02c6c7c-8b90-468f-811d-45ef807b4116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5495960c-f8cc-485d-8ba9-3625955eb64b_gkmp3uvv Sep 28 12:33:57 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02c6c7c-8b90-468f-811d-45ef807b4116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2105012812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4584500-a83d-4b8d-8a44-e868471ef93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:57Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dae181a-78e6-4bd3-aacc-27b37c7f9170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dae181a-78e6-4bd3-aacc-27b37c7f9170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea77e48-5de7-465d-8ab1-cd586426bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea77e48-5de7-465d-8ab1-cd586426bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4584500-a83d-4b8d-8a44-e868471ef93e', 'volume_name': 'volume-a4584500-a83d-4b8d-8a44-e868471ef93e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a3391a-2438-4484-9140-f517bb9cd551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a3391a-2438-4484-9140-f517bb9cd551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffb5515-d631-45aa-ab57-8ac6693cf7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume a4584500-a83d-4b8d-8a44-e868471ef93e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4584500-a83d-4b8d-8a44-e868471ef93e', 'volume_size': 1} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3c13cd6f-fbc5-45cc-8f94-08f9596421b2" returned: 0 in 0.598s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-3c13cd6f-fbc5-45cc-8f94-08f9596421b2" released by "delete_volume" :: held 1.233s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Created reservations ['1542d520-aae1-4a2e-920e-0d2bebd29910', '5a7bb87b-1762-45db-9786-469a8dc92b11', '6c2681dc-c0f2-4a81-a001-522cc846a2c3', '2e3727d9-6a97-45c0-a78e-52948a1b4199'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:57 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:33:57 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:57 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 1073741824" returned: 0 in 0.694s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:57 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5495960c-f8cc-485d-8ba9-3625955eb64b_gkmp3uvv" returned: 0 in 0.520s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5495960c-f8cc-485d-8ba9-3625955eb64b_gkmp3uvv {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:57 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 Sep 28 12:33:57 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:57 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5495960c-f8cc-485d-8ba9-3625955eb64b_gkmp3uvv Sep 28 12:33:57 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (49f2119b-d547-4c70-ab6a-f5b6ba3435d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d9cda0-52aa-466b-a674-5c31222fa660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d9cda0-52aa-466b-a674-5c31222fa660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50104776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181b4484-833e-49af-8a2f-1ee84077db53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:57Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267eab83-07cd-4efb-96a1-0461c01b7bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267eab83-07cd-4efb-96a1-0461c01b7bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451beed2-100f-46f2-a071-10298e5598bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451beed2-100f-46f2-a071-10298e5598bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '181b4484-833e-49af-8a2f-1ee84077db53', 'volume_name': 'volume-181b4484-833e-49af-8a2f-1ee84077db53', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093db40a-d07d-4447-8c69-8662ecc9308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093db40a-d07d-4447-8c69-8662ecc9308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a33d083-16c8-4318-ad4e-6cd752b33f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume 181b4484-833e-49af-8a2f-1ee84077db53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-181b4484-833e-49af-8a2f-1ee84077db53', 'volume_size': 1} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.383s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Deleted volume successfully. Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-efa2117e-dddb-4bda-badf-200e0941e14b tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-3c13cd6f-fbc5-45cc-8f94-08f9596421b2-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:57 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5" returned: 0 in 0.344s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b20c8e-fc9d-44ce-940c-36d277ff1fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6229771a-293a-4913-aa2c-9d74b6acfa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot b05b44e4-dff9-46ab-89e7-456ae7093cb6 of volume 0797f996-3062-43bb-9426-13e18852b7f6 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:33:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 (86c92b0a-21e2-4f93-95e5-ded9d6fc88b5): created successfully Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6229771a-293a-4913-aa2c-9d74b6acfa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (4b6078af-cfdb-4320-a5d9-8823e9e805a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae067d-621a-45f6-abe5-43b91ae830a9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:57 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5495960c-f8cc-485d-8ba9-3625955eb64b_gkmp3uvv" returned: 1 in 0.499s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5495960c-f8cc-485d-8ba9-3625955eb64b_gkmp3uvv' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc31c88-35b9-41ae-a630-08483ecbe912]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-68afe72a-c82a-44d8-94e5-f145770de081 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created volume successfully. Sep 28 12:33:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:58 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 Sep 28 12:33:58 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:58 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD Sep 28 12:33:58 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-2a89570b-c603-4b25-a839-6026ae8e661d-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (c506d91e-c4b3-427c-8843-a0c0eaf9d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2171490b-a405-4d17-8647-2c74a71c4367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-2a89570b-c603-4b25-a839-6026ae8e661d-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2171490b-a405-4d17-8647-2c74a71c4367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-743544811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7744c14-db97-40e3-a3b0-b3d156af9f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:58Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91fae83-9150-437c-8077-d7fb94d6fb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91fae83-9150-437c-8077-d7fb94d6fb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859f8281-42c8-47de-b7f7-14016d7dab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859f8281-42c8-47de-b7f7-14016d7dab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7744c14-db97-40e3-a3b0-b3d156af9f99', 'volume_name': 'volume-f7744c14-db97-40e3-a3b0-b3d156af9f99', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859e252d-a3d1-44ce-8092-58e3304b57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859e252d-a3d1-44ce-8092-58e3304b57d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0170db5-3ca8-4e61-b521-11b29604a0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume f7744c14-db97-40e3-a3b0-b3d156af9f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7744c14-db97-40e3-a3b0-b3d156af9f99', 'volume_size': 1} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-quobyte-2a89570b-c603-4b25-a839-6026ae8e661d" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-2a89570b-c603-4b25-a839-6026ae8e661d" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:58 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e851f9b-5f6e-4c2b-942d-c4ec1c81203e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:58 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6" returned: 0 in 0.556s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:58 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 1G Sep 28 12:33:58 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:58 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d Sep 28 12:33:58 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:58 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD Sep 28 12:33:58 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (245bc80e-8d16-4a6d-8a85-ef4cf4a07909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4c3f42-f894-4394-9e86-d3bf7baa3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4c3f42-f894-4394-9e86-d3bf7baa3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376379194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6aeefe0-294d-4dd5-91fb-840d2a95bb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:59Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941ef0bd-5e6d-4315-b8a9-31453fb9f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941ef0bd-5e6d-4315-b8a9-31453fb9f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0549d1af-9d1e-4cac-8fa2-8365ca8f28bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0549d1af-9d1e-4cac-8fa2-8365ca8f28bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6aeefe0-294d-4dd5-91fb-840d2a95bb89', 'volume_name': 'volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c68e63c-7e10-4e95-abff-40cb62671379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c68e63c-7e10-4e95-abff-40cb62671379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b1f3d1-7bb9-4740-b69c-d45c56fb5576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume e6aeefe0-294d-4dd5-91fb-840d2a95bb89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89', 'volume_size': 1} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:58 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD" returned: 1 in 0.514s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] 5495960c-f8cc-485d-8ba9-3625955eb64b was raw, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:58 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d" returned: 0 in 0.522s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:58 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad Sep 28 12:33:58 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:59 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d Sep 28 12:33:59 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:59 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 1G" returned: 0 in 0.572s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0797f996-3062-43bb-9426-13e18852b7f6 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:59 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0797f996-3062-43bb-9426-13e18852b7f6 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 Sep 28 12:33:59 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:59 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2a89570b-c603-4b25-a839-6026ae8e661d" returned: 0 in 0.270s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-2a89570b-c603-4b25-a839-6026ae8e661d" released by "delete_volume" :: held 0.862s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Created reservations ['bc3365ff-2894-4505-a670-8a583b9afc3f', '788e75f2-5987-43d4-9f17-b10e388207da', 'b5844243-526e-49b7-99ae-27f2896ae8ad', '56b8fc48-8a50-46d0-9ea8-aa27e06c9a04'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:59 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0797f996-3062-43bb-9426-13e18852b7f6 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6" returned: 0 in 0.332s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:59 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 is being set with open permissions: ugo+rw Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:59 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 Sep 28 12:33:59 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:59 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:33:59 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:59 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad" returned: 0 in 0.560s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5495960c-f8cc-485d-8ba9-3625955eb64b_yu5_8i49devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:33:59 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:59 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad 1G Sep 28 12:33:59 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:59 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6" returned: 0 in 0.284s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:59 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.285s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Deleted volume successfully. Sep 28 12:33:59 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.info Sep 28 12:33:59 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7a7a9fef-b469-422f-97ac-601886baf851 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-2a89570b-c603-4b25-a839-6026ae8e661d-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:59 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad 1G" returned: 0 in 0.363s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Downloaded image 5495960c-f8cc-485d-8ba9-3625955eb64b ((None, [{'url': 'file:///opt/stack/data/glance/images/5495960c-f8cc-485d-8ba9-3625955eb64b', 'metadata': {}}])) to volume 6ca549e0-b544-4338-9617-37b6f1fedfad successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Temporary image 5495960c-f8cc-485d-8ba9-3625955eb64b for user 37d1482ca0db45abb1606569c818b19f is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Marking volume 6ca549e0-b544-4338-9617-37b6f1fedfad as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Copying metadata from image 5495960c-f8cc-485d-8ba9-3625955eb64b to 6ca549e0-b544-4338-9617-37b6f1fedfad. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:33:59 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Creating volume glance metadata for volume 6ca549e0-b544-4338-9617-37b6f1fedfad backed by image 5495960c-f8cc-485d-8ba9-3625955eb64b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5495960c-f8cc-485d-8ba9-3625955eb64b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '74b9c8b8147a2b6ec5c658c9e7bc1814', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff65a75-35d4-499a-8100-056968f9cd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca549e0-b544-4338-9617-37b6f1fedfad', 'volume_size': 1, 'image_id': '5495960c-f8cc-485d-8ba9-3625955eb64b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5495960c-f8cc-485d-8ba9-3625955eb64b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '74b9c8b8147a2b6ec5c658c9e7bc1814', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b06038e006c84390bd520a18e125d02e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f46f2f6fba1a594fe6d9c2783af8fee480cbf5ec740e92873f5191e6d5616bd8dcf669ecc0101eb3e8f591bc6ff6c48a4312b73340e42446ae21cdd73c2dc56', 'id': '5495960c-f8cc-485d-8ba9-3625955eb64b', 'created_at': datetime.datetime(2026, 9, 28, 10, 33, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 33, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5495960c-f8cc-485d-8ba9-3625955eb64b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b8cd0c-afe7-4f0b-933a-315a3ba5538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:00 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.info" returned: 0 in 0.348s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.info is being set with open permissions: ugo+rw Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:00 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.info Sep 28 12:34:00 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:00 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Volume volume-6ca549e0-b544-4338-9617-37b6f1fedfad (6ca549e0-b544-4338-9617-37b6f1fedfad): created successfully Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b8cd0c-afe7-4f0b-933a-315a3ba5538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Flow 'volume_create_manager' (dd56b48a-ced3-41dc-87de-31e0ca99f651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d4280f3b-195c-4a52-9c79-d23abffce986 tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Created volume successfully. Sep 28 12:34:00 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.info" returned: 0 in 0.274s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.528s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.178s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2105012812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4584500-a83d-4b8d-8a44-e868471ef93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:57Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Creating volume a4584500-a83d-4b8d-8a44-e868471ef93e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:00 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:00 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e 1073741824 Sep 28 12:34:00 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b63042df-ab04-45ce-a2ce-cc4776684deb tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-5102886e-2fec-4fbd-9611-0c1af1872aec-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-5102886e-2fec-4fbd-9611-0c1af1872aec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "cinder-quobyte-5102886e-2fec-4fbd-9611-0c1af1872aec" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-5102886e-2fec-4fbd-9611-0c1af1872aec" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[40049248-562a-4158-9555-616ea1cc6ec0]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:00 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec Sep 28 12:34:00 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:00 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e 1073741824" returned: 0 in 0.438s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:00 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e Sep 28 12:34:00 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:00 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec" returned: 0 in 0.413s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec Sep 28 12:34:01 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:01 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-b05b44e4-dff9-46ab-89e7-456ae7093cb6-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.394s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50104776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181b4484-833e-49af-8a2f-1ee84077db53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:57Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Creating volume 181b4484-833e-49af-8a2f-1ee84077db53 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:01 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 1073741824 Sep 28 12:34:01 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffb5515-d631-45aa-ab57-8ac6693cf7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4584500-a83d-4b8d-8a44-e868471ef93e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a326ecd-c085-44af-9e71-13cef1e2428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-b05b44e4-dff9-46ab-89e7-456ae7093cb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-0797f996-3062-43bb-9426-13e18852b7f6" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:01 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume volume-a4584500-a83d-4b8d-8a44-e868471ef93e (a4584500-a83d-4b8d-8a44-e868471ef93e): created successfully Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a326ecd-c085-44af-9e71-13cef1e2428f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (bf15edca-6636-4606-8877-5064d495bb16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-0797f996-3062-43bb-9426-13e18852b7f6" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-b05b44e4-dff9-46ab-89e7-456ae7093cb6" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Acquiring lock "cinder-6ca549e0-b544-4338-9617-37b6f1fedfad-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6fcb1b9a-d485-4461-9313-b945c9b9b190 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created volume successfully. Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-b05b44e4-dff9-46ab-89e7-456ae7093cb6" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot b05b44e4-dff9-46ab-89e7-456ae7093cb6 of volume 0797f996-3062-43bb-9426-13e18852b7f6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:01 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "cinder-6ca549e0-b544-4338-9617-37b6f1fedfad-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5102886e-2fec-4fbd-9611-0c1af1872aec" returned: 0 in 0.349s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[27327a94-8f17-4a8b-a6c4-18e2fbef7780]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-quobyte-5102886e-2fec-4fbd-9611-0c1af1872aec" released by "delete_volume" :: held 0.835s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Acquiring lock "cinder-quobyte-6ca549e0-b544-4338-9617-37b6f1fedfad" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "cinder-quobyte-6ca549e0-b544-4338-9617-37b6f1fedfad" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca10552-ddb1-4318-af1f-87f115d8a030]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Created reservations ['530c1155-71da-4e4e-9a8f-d21a5c85c17e', '6ec2ec1b-959e-431c-8347-5cbe6b2b8d7d', 'd41b0100-a2fe-4ae6-9360-63b58a7c3d61', '11427fa8-ca45-4251-a1c5-1b8a3ff24d6c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:01 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 Sep 28 12:34:01 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad Sep 28 12:34:01 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:01 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:01 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:01 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 1073741824" returned: 0 in 0.610s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 Sep 28 12:34:01 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:01 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6" returned: 0 in 0.553s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0797f996-3062-43bb-9426-13e18852b7f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[20861e66-5fc6-429a-a079-e3a4635524c5]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.400s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:01 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad" returned: 0 in 0.536s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Deleted volume successfully. Sep 28 12:34:02 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad Sep 28 12:34:02 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d38ab1d9-7dde-41bc-b28e-4d427dbdf679 tempest-CreateVolumesFromImageTest-797939417 None] Lock "cinder-5102886e-2fec-4fbd-9611-0c1af1872aec-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:02 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 Sep 28 12:34:02 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53" returned: 0 in 0.419s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.899s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-743544811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7744c14-db97-40e3-a3b0-b3d156af9f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:58Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Creating volume f7744c14-db97-40e3-a3b0-b3d156af9f99 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:02 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 1073741824 Sep 28 12:34:02 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a33d083-16c8-4318-ad4e-6cd752b33f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-181b4484-833e-49af-8a2f-1ee84077db53', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3f9301-146d-4900-807c-ee6f7e4df189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:02 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume volume-181b4484-833e-49af-8a2f-1ee84077db53 (181b4484-833e-49af-8a2f-1ee84077db53): created successfully Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3f9301-146d-4900-807c-ee6f7e4df189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (49f2119b-d547-4c70-ab6a-f5b6ba3435d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:02 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4d9bc0ae-4370-4f4f-93ff-8538761d18c1 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created volume successfully. Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6ca549e0-b544-4338-9617-37b6f1fedfad" returned: 0 in 0.394s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "cinder-quobyte-6ca549e0-b544-4338-9617-37b6f1fedfad" released by "delete_volume" :: held 0.988s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:02 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6" returned: 0 in 0.524s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Created reservations ['49558eff-83b9-45b4-bec1-c2dfa33a5df6', 'f670f064-7d47-49a8-bdad-078eeba7588d', 'c4eba9b9-d099-4ade-a8fe-6200f9ede4e9', 'edea8bf7-1e9d-4031-9ee2-5e7a3302ccaa'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:02 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 Sep 28 12:34:02 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:02 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 1073741824" returned: 0 in 0.638s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.359s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6" returned: 0 in 0.482s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Deleted volume successfully. Sep 28 12:34:02 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 Sep 28 12:34:02 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:03 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6 Sep 28 12:34:03 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-82b65122-d8c7-490e-8ec6-0a2b75746b5a tempest-VolumeAndVolumeTypeFromImageTest-442611690 None] Lock "cinder-6ca549e0-b544-4338-9617-37b6f1fedfad-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:03 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99" returned: 0 in 0.289s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.411s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376379194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6aeefe0-294d-4dd5-91fb-840d2a95bb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1602b3f3ffce450abb92dfe3846679d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:59Z,use_quota=True,user_id='3ea5131bc1754e729bb83808bb14eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Creating volume e6aeefe0-294d-4dd5-91fb-840d2a95bb89 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:03 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:03 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0170db5-3ca8-4e61-b521-11b29604a0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7744c14-db97-40e3-a3b0-b3d156af9f99', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:03 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 1073741824 Sep 28 12:34:03 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b97ec87-0420-431e-8089-79ef35cb6e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6.b05b44e4-dff9-46ab-89e7-456ae7093cb6" returned: 0 in 0.389s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:03 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 (f7744c14-db97-40e3-a3b0-b3d156af9f99): created successfully Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b97ec87-0420-431e-8089-79ef35cb6e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (c506d91e-c4b3-427c-8843-a0c0eaf9d95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-b05b44e4-dff9-46ab-89e7-456ae7093cb6" released by "_delete_snapshot" :: held 2.153s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9441bd24-8756-48cd-b740-870347698201 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created volume successfully. Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-0797f996-3062-43bb-9426-13e18852b7f6" released by "delete_snapshot" :: held 2.218s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Created reservations ['65e7aa82-85a7-4e20-a1c4-4742e0bbf030', 'dcb9e9dc-05dd-4070-9159-0d1bb04d6d3f', '1f81bc62-c13e-420f-8d38-cd518f1c5988', 'f518d0b6-0922-43db-802c-fc84d57e0ac4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:34:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c725f8a3-b6e2-474b-a1fd-579e68bd9160 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-b05b44e4-dff9-46ab-89e7-456ae7093cb6-delete_snapshot" released by "delete_snapshot" :: held 2.532s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:04 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 1073741824" returned: 0 in 0.786s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:04 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 Sep 28 12:34:04 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:04 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b1f3d1-7bb9-4740-b69c-d45c56fb5576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f7670a-22ad-4acb-b97d-57538cd4d710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-0797f996-3062-43bb-9426-13e18852b7f6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Volume volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 (e6aeefe0-294d-4dd5-91fb-840d2a95bb89): created successfully Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f7670a-22ad-4acb-b97d-57538cd4d710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Flow 'volume_create_manager' (245bc80e-8d16-4a6d-8a85-ef4cf4a07909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Lock "cinder-0797f996-3062-43bb-9426-13e18852b7f6-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7d87fda9-344f-4d3e-9cea-498d5ab37305 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created volume successfully. Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-0797f996-3062-43bb-9426-13e18852b7f6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-0797f996-3062-43bb-9426-13e18852b7f6" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f76dc-34ba-456b-a457-18d734e6c06a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:04 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 Sep 28 12:34:04 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6" returned: 0 in 0.415s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:05 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6 Sep 28 12:34:05 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-0797f996-3062-43bb-9426-13e18852b7f6" returned: 0 in 0.249s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-0797f996-3062-43bb-9426-13e18852b7f6" released by "delete_volume" :: held 0.750s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Created reservations ['1897a8e1-9120-4aed-9a81-595b121109cc', 'd59a78db-a446-4bd4-9e28-466d2f5ef196', 'eb2a40f1-6ccd-4441-ad60-a9684a7f1b50', '6c03e25c-a473-404e-8a21-579c00736583'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:05 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:05 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-e6aeefe0-294d-4dd5-91fb-840d2a95bb89-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-e6aeefe0-294d-4dd5-91fb-840d2a95bb89-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:05 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-quobyte-e6aeefe0-294d-4dd5-91fb-840d2a95bb89" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-e6aeefe0-294d-4dd5-91fb-840d2a95bb89" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b62e4-c48c-4566-bac6-7faf83a9ea53]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4ea58adc-51cf-4edf-8ff6-590fa8d7bb0a tempest-ProjectMemberTests-1684550222 None] Lock "cinder-0797f996-3062-43bb-9426-13e18852b7f6-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:06 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 Sep 28 12:34:06 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (e9d43438-6d68-4c78-b1f0-e796da4a061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6842c2e1-a095-4ed3-9e91-05a278e1444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6842c2e1-a095-4ed3-9e91-05a278e1444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1670788995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90b004f-162a-4e97-a747-43f9c41854e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:06Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c774dbd-a8b8-4a3b-bea5-9e08b91a6e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c774dbd-a8b8-4a3b-bea5-9e08b91a6e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863a2362-ac19-4a22-b0cd-7bc989578895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863a2362-ac19-4a22-b0cd-7bc989578895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90b004f-162a-4e97-a747-43f9c41854e7', 'volume_name': 'volume-d90b004f-162a-4e97-a747-43f9c41854e7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887221d1-c7bf-4be3-a885-f5fd4dd19222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887221d1-c7bf-4be3-a885-f5fd4dd19222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b579a176-02e8-4875-8363-2a9e8660ecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume d90b004f-162a-4e97-a747-43f9c41854e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90b004f-162a-4e97-a747-43f9c41854e7', 'volume_size': 1} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1670788995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90b004f-162a-4e97-a747-43f9c41854e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:06Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Creating volume d90b004f-162a-4e97-a747-43f9c41854e7 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:06 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:06 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 1073741824 Sep 28 12:34:06 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (a6f2664c-e56a-452b-8a10-ff34d80361e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:06 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd09a662-7d9e-4aa4-aba2-9048cc7f81a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89" returned: 0 in 0.512s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:06 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89 Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd09a662-7d9e-4aa4-aba2-9048cc7f81a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986324670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65df723f-cd71-4667-971d-a9025c5f51d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:06Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:06 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1222c743-af2a-46e7-9d54-1bf2432833a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1222c743-af2a-46e7-9d54-1bf2432833a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df82372f-e8ca-4cee-92ff-4fb689fd4ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df82372f-e8ca-4cee-92ff-4fb689fd4ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65df723f-cd71-4667-971d-a9025c5f51d7', 'volume_name': 'volume-65df723f-cd71-4667-971d-a9025c5f51d7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2bb8bd-ca13-4d88-9fbe-5b27d6b6b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b2bb8bd-ca13-4d88-9fbe-5b27d6b6b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5ef6ca-9543-4d00-9f43-c6784853ec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Volume 65df723f-cd71-4667-971d-a9025c5f51d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65df723f-cd71-4667-971d-a9025c5f51d7', 'volume_size': 1} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:06 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e6aeefe0-294d-4dd5-91fb-840d2a95bb89" returned: 0 in 0.341s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-e6aeefe0-294d-4dd5-91fb-840d2a95bb89" released by "delete_volume" :: held 0.948s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:06 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 1073741824" returned: 0 in 0.579s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created reservations ['9d16897b-b840-44ea-a6a0-2f5f4221ad4e', '38173c13-d133-4ee5-b345-c69b41e08633', '4b5218c0-8347-487b-94f7-f8fa383c8310', '82b0534b-383c-4b83-b03f-558a347db96f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:06 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 Sep 28 12:34:06 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:06 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:06 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-f7744c14-db97-40e3-a3b0-b3d156af9f99-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-f7744c14-db97-40e3-a3b0-b3d156af9f99-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-quobyte-f7744c14-db97-40e3-a3b0-b3d156af9f99" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:07 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7" returned: 0 in 0.385s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986324670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65df723f-cd71-4667-971d-a9025c5f51d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:06Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Creating volume 65df723f-cd71-4667-971d-a9025c5f51d7 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:07 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-f7744c14-db97-40e3-a3b0-b3d156af9f99" acquired by "delete_volume" :: waited 0.063s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:07 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 1073741824 Sep 28 12:34:07 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b579a176-02e8-4875-8363-2a9e8660ecd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90b004f-162a-4e97-a747-43f9c41854e7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:07 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b14fa81-d4e8-412f-9a9b-569a38193b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8df8bb6-681a-410d-ac1b-172691b1dfce]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.432s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume volume-d90b004f-162a-4e97-a747-43f9c41854e7 (d90b004f-162a-4e97-a747-43f9c41854e7): created successfully Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b14fa81-d4e8-412f-9a9b-569a38193b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (e9d43438-6d68-4c78-b1f0-e796da4a061d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Deleted volume successfully. Sep 28 12:34:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7826e284-781c-46b9-a3a7-ea35f1bba1cf tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created volume successfully. Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e604eb65-c2ec-4ef3-a489-7ac91f0e0678 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-e6aeefe0-294d-4dd5-91fb-840d2a95bb89-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:07 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 Sep 28 12:34:07 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:07 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 1073741824" returned: 0 in 0.507s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:07 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99" returned: 0 in 0.443s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:07 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99 Sep 28 12:34:07 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:07 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 Sep 28 12:34:07 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:08 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-f7744c14-db97-40e3-a3b0-b3d156af9f99" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-f7744c14-db97-40e3-a3b0-b3d156af9f99" released by "delete_volume" :: held 0.835s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:08 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7" returned: 0 in 0.290s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5ef6ca-9543-4d00-9f43-c6784853ec7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65df723f-cd71-4667-971d-a9025c5f51d7', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df8bb0a-3ac9-47a5-9892-8334c8fdf40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Volume volume-65df723f-cd71-4667-971d-a9025c5f51d7 (65df723f-cd71-4667-971d-a9025c5f51d7): created successfully Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df8bb0a-3ac9-47a5-9892-8334c8fdf40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (a6f2664c-e56a-452b-8a10-ff34d80361e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-46a90c02-e764-444a-b406-924526f4a777 tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created reservations ['c679aa80-4ee2-4b07-90fa-ac6ed7ec1eba', '53ea49a1-c951-4095-aa28-3b528dc818cc', '7599fcd4-8151-4ac6-9b7c-1c7763cca0a1', '0acd58fe-e9d7-4405-b56b-d1e2769fb0a6'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:08 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:08 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:08 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.344s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:08 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Deleted volume successfully. Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot 1c1500f3-ecf3-4212-9ab7-09316d66cc03 of volume 65df723f-cd71-4667-971d-a9025c5f51d7 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3da45d67-7420-4176-8c2f-a239d723a3b8 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-f7744c14-db97-40e3-a3b0-b3d156af9f99-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[85337f9e-00ea-4f6d-990f-63c0191bfd3e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:08 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 Sep 28 12:34:08 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (cb1a20c7-533f-4bbe-a3c7-6c837388581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c26b4b5-60cf-4dd3-9ffc-aa8be4ddccd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c26b4b5-60cf-4dd3-9ffc-aa8be4ddccd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2143948239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2191e3f9-e217-435a-b341-7978e617b154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:09Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5a5c3e-be7b-4723-86d7-2717e9ddb06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5a5c3e-be7b-4723-86d7-2717e9ddb06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1934c2f0-af64-4304-aa73-53878f74222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1934c2f0-af64-4304-aa73-53878f74222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2191e3f9-e217-435a-b341-7978e617b154', 'volume_name': 'volume-2191e3f9-e217-435a-b341-7978e617b154', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ade40b4-9581-4150-bef3-ae6c46b6f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ade40b4-9581-4150-bef3-ae6c46b6f41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1d01da-f692-437e-a925-8424ad1bf853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume 2191e3f9-e217-435a-b341-7978e617b154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2191e3f9-e217-435a-b341-7978e617b154', 'volume_size': 1} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:09 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7" returned: 0 in 0.475s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:09 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 1G Sep 28 12:34:09 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (edf117a1-f6bc-4ffe-ab21-fb1e194cbbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfb3a9a-07e5-4741-969e-5676c09a4b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-181b4484-833e-49af-8a2f-1ee84077db53-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfb3a9a-07e5-4741-969e-5676c09a4b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894296985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74653720-ef94-4391-b33f-07d2358eaef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:09Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9336f9fe-8ce1-4f3c-a6c9-a6dd26c43a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9336f9fe-8ce1-4f3c-a6c9-a6dd26c43a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cfaf41-f4f2-4f53-b2f6-1bc73e576784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cfaf41-f4f2-4f53-b2f6-1bc73e576784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74653720-ef94-4391-b33f-07d2358eaef9', 'volume_name': 'volume-74653720-ef94-4391-b33f-07d2358eaef9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4b29a0-7ca8-4b21-b0bb-490fe94542a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4b29a0-7ca8-4b21-b0bb-490fe94542a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d10e2d4-3d7e-4702-9767-8f19ba2f023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume 74653720-ef94-4391-b33f-07d2358eaef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74653720-ef94-4391-b33f-07d2358eaef9', 'volume_size': 1} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-181b4484-833e-49af-8a2f-1ee84077db53-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-quobyte-181b4484-833e-49af-8a2f-1ee84077db53" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-181b4484-833e-49af-8a2f-1ee84077db53" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead430fc-d47f-4ab9-ab7a-c1d92463c6d6]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:09 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 1G" returned: 0 in 0.553s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65df723f-cd71-4667-971d-a9025c5f51d7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:09 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65df723f-cd71-4667-971d-a9025c5f51d7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 Sep 28 12:34:09 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:09 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 Sep 28 12:34:09 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (3f535f1e-2e9a-45ee-b089-991a2ac4af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb62e44-9c7b-4f9a-b8eb-061b22d357c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:10 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53" returned: 0 in 0.485s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65df723f-cd71-4667-971d-a9025c5f51d7 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03" returned: 0 in 0.412s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:10 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 is being set with open permissions: ugo+rw Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb62e44-9c7b-4f9a-b8eb-061b22d357c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577048760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b742aa9b-9e2a-4b9a-8c42-de0b445bc56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:10Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53 Sep 28 12:34:10 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819aca5d-cb34-42ca-96fc-ebd267995901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819aca5d-cb34-42ca-96fc-ebd267995901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ffbed9-0991-463f-8e61-ac9b0a792c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ffbed9-0991-463f-8e61-ac9b0a792c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b742aa9b-9e2a-4b9a-8c42-de0b445bc56c', 'volume_name': 'volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a06019-ffba-4b01-a62c-ab47f87aa264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a06019-ffba-4b01-a62c-ab47f87aa264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb64c59-6403-4b6e-8644-7c9ade3453b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume b742aa9b-9e2a-4b9a-8c42-de0b445bc56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c', 'volume_size': 1} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:10 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:10 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-181b4484-833e-49af-8a2f-1ee84077db53" returned: 0 in 0.385s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:10 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03" returned: 0 in 0.388s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-181b4484-833e-49af-8a2f-1ee84077db53" released by "delete_volume" :: held 0.929s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:10 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.info Sep 28 12:34:10 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created reservations ['769b311c-51e7-49ac-81a3-1df3a9da4a3e', '2a3387a1-c592-4dd0-9b83-709553387a0f', '2f2fe564-2f42-438b-8698-76d58e73dd48', 'e35a13f4-7bf7-4c62-a211-59b713d0ccbc'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (e71182da-5f23-43d8-9f25-56a0fca56701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fde7f4-19a9-472d-8dff-585ed9088b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fde7f4-19a9-472d-8dff-585ed9088b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-224042748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75917f66-c8d9-4a9d-8cf9-00c7d6c06357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:11Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b196e4-ef11-4edc-a6cc-9c854b576747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b196e4-ef11-4edc-a6cc-9c854b576747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eba83d-ad39-45c4-b7a8-cc93e1984b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eba83d-ad39-45c4-b7a8-cc93e1984b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75917f66-c8d9-4a9d-8cf9-00c7d6c06357', 'volume_name': 'volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688cab0b-0afb-464f-89e5-5cab545deb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688cab0b-0afb-464f-89e5-5cab545deb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de206ecc-a3a1-4d0a-a0fb-175159b448e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume 75917f66-c8d9-4a9d-8cf9-00c7d6c06357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357', 'volume_size': 1} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Flow 'volume_create_manager' (98d6ab0b-ac95-49ed-975c-b85bd7e8d4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5111c400-46ea-4e0a-8048-9bf4bda297fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5111c400-46ea-4e0a-8048-9bf4bda297fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1169470510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe3ead2-02d2-4f58-a46f-79c941426d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac1c6d2fcd83452e97f61d83d720b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:11Z,use_quota=True,user_id='6128c42195c340729db79fe262e12937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb8b07e-140e-4dbc-b8d6-f293f20ea292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb8b07e-140e-4dbc-b8d6-f293f20ea292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4341bcb8-3b14-49e5-af19-7ce5a46a43a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4341bcb8-3b14-49e5-af19-7ce5a46a43a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe3ead2-02d2-4f58-a46f-79c941426d03', 'volume_name': 'volume-fbe3ead2-02d2-4f58-a46f-79c941426d03', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a08bc9b-e7d2-41a8-a72f-9863bc666941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a08bc9b-e7d2-41a8-a72f-9863bc666941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a71b4f-c8b4-44d2-b60f-b4d0c9ac698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Volume fbe3ead2-02d2-4f58-a46f-79c941426d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe3ead2-02d2-4f58-a46f-79c941426d03', 'volume_size': 1} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.info" returned: 0 in 0.474s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:11 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.info is being set with open permissions: ugo+rw Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:11 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.info Sep 28 12:34:11 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:11 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:11 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:11 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.info" returned: 0 in 0.266s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.215s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2143948239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2191e3f9-e217-435a-b341-7978e617b154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:09Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Creating volume 2191e3f9-e217-435a-b341-7978e617b154 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:11 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:11 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:11 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 1073741824 Sep 28 12:34:11 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.306s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Deleted volume successfully. Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (be3d0428-971f-4507-8001-db265f61bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4782f1-f0f0-4b5e-83cd-a4f95d04cf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-568f6b4c-345f-4d6f-bc0d-09b24876152d tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4782f1-f0f0-4b5e-83cd-a4f95d04cf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-81432149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027ade68-4c2a-411c-9fc6-938fbcd34254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:11Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdd8f07-d6ac-4aa4-a3ad-9284daf02a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdd8f07-d6ac-4aa4-a3ad-9284daf02a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464c52eb-19c5-46cd-8035-cb191ebf85c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464c52eb-19c5-46cd-8035-cb191ebf85c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027ade68-4c2a-411c-9fc6-938fbcd34254', 'volume_name': 'volume-027ade68-4c2a-411c-9fc6-938fbcd34254', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e39bff-bdaf-4ec9-99af-26c7324f5467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e39bff-bdaf-4ec9-99af-26c7324f5467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be9bc0d-6dea-460f-a8f1-6e8b3c715c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:11 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume 027ade68-4c2a-411c-9fc6-938fbcd34254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027ade68-4c2a-411c-9fc6-938fbcd34254', 'volume_size': 1} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-b708c777-7b86-4b0a-a7ab-6990b004f3dc tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-181b4484-833e-49af-8a2f-1ee84077db53-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-a4584500-a83d-4b8d-8a44-e868471ef93e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-a4584500-a83d-4b8d-8a44-e868471ef93e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:11 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 1073741824" returned: 0 in 0.484s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-quobyte-a4584500-a83d-4b8d-8a44-e868471ef93e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-a4584500-a83d-4b8d-8a44-e868471ef93e" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1114a2-dcfd-4904-93a7-098308d3a392]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:11 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 Sep 28 12:34:11 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-1c1500f3-ecf3-4212-9ab7-09316d66cc03-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Lock "cinder-1c1500f3-ecf3-4212-9ab7-09316d66cc03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-65df723f-cd71-4667-971d-a9025c5f51d7" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-65df723f-cd71-4667-971d-a9025c5f51d7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-1c1500f3-ecf3-4212-9ab7-09316d66cc03" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-1c1500f3-ecf3-4212-9ab7-09316d66cc03" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot 1c1500f3-ecf3-4212-9ab7-09316d66cc03 of volume 65df723f-cd71-4667-971d-a9025c5f51d7 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f03874-f901-4123-b284-f33b3825d8a9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e Sep 28 12:34:12 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 Sep 28 12:34:12 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154" returned: 0 in 0.282s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894296985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74653720-ef94-4391-b33f-07d2358eaef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:09Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Creating volume 74653720-ef94-4391-b33f-07d2358eaef9 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:12 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1d01da-f692-437e-a925-8424ad1bf853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2191e3f9-e217-435a-b341-7978e617b154', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7e2d4f-b174-4dc1-81cf-c6464673d5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:12 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 1073741824 Sep 28 12:34:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume volume-2191e3f9-e217-435a-b341-7978e617b154 (2191e3f9-e217-435a-b341-7978e617b154): created successfully Sep 28 12:34:12 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7e2d4f-b174-4dc1-81cf-c6464673d5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (cb1a20c7-533f-4bbe-a3c7-6c837388581a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f2526bde-664a-4958-bcd2-e8d43cc8acf2 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created volume successfully. Sep 28 12:34:12 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e" returned: 0 in 0.427s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e Sep 28 12:34:12 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03" returned: 0 in 0.434s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65df723f-cd71-4667-971d-a9025c5f51d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b013b342-b360-4208-a64f-9c1fe6f027cd]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a4584500-a83d-4b8d-8a44-e868471ef93e" returned: 0 in 0.291s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-a4584500-a83d-4b8d-8a44-e868471ef93e" released by "delete_volume" :: held 0.781s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:12 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 Sep 28 12:34:12 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created reservations ['6893b961-5010-4c7f-91f8-1fb4395bc640', '0be426bf-600d-452a-b8dc-57647b1ac7de', 'd89ae0d5-7dff-4e95-b20e-108311f5f06d', '0d8ad7dc-35e2-4d35-8fd5-3629a4b3e9c5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:12 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 1073741824" returned: 0 in 0.535s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 Sep 28 12:34:12 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:12 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:13 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7" returned: 0 in 0.467s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:13 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 Sep 28 12:34:13 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-quobyte-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:13 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.910s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577048760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b742aa9b-9e2a-4b9a-8c42-de0b445bc56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:10Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Creating volume b742aa9b-9e2a-4b9a-8c42-de0b445bc56c {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:13 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d10e2d4-3d7e-4702-9767-8f19ba2f023c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74653720-ef94-4391-b33f-07d2358eaef9', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dd4801-9258-4ec9-9428-47a8a8c517c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:13 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c 1073741824 Sep 28 12:34:13 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5" acquired by "delete_volume" :: waited 0.067s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:13 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.371s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Deleted volume successfully. Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6eab68-5d9f-4ced-bb0d-c2721b5a830d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume volume-74653720-ef94-4391-b33f-07d2358eaef9 (74653720-ef94-4391-b33f-07d2358eaef9): created successfully Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05dd4801-9258-4ec9-9428-47a8a8c517c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (edf117a1-f6bc-4ffe-ab21-fb1e194cbbfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bc06b8dd-0509-4b2b-81a8-5603b7adabaf tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-a4584500-a83d-4b8d-8a44-e868471ef93e-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4a2bd98a-074c-4a80-b078-753af5de91e4 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created volume successfully. Sep 28 12:34:13 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 Sep 28 12:34:13 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03" returned: 0 in 0.474s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:13 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03 Sep 28 12:34:13 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c 1073741824" returned: 0 in 0.546s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5" returned: 0 in 0.495s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:13 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c Sep 28 12:34:13 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7.1c1500f3-ecf3-4212-9ab7-09316d66cc03" returned: 0 in 0.274s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5 Sep 28 12:34:13 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-1c1500f3-ecf3-4212-9ab7-09316d66cc03" released by "_delete_snapshot" :: held 1.783s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-65df723f-cd71-4667-971d-a9025c5f51d7" released by "delete_snapshot" :: held 1.812s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:13 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Created reservations ['2e4aea68-b7df-4be1-aeb7-9931ccd605a2', 'c22ae782-3e9d-4f3b-8cf0-729ad22b7c50', '2d8977f5-dd4c-40d2-82d7-27cc86ccf206', '8a745365-edab-4f7f-9731-d85068f4430d'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:14 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c" returned: 0 in 0.290s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.069s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-224042748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75917f66-c8d9-4a9d-8cf9-00c7d6c06357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:11Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:14 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Creating volume 75917f66-c8d9-4a9d-8cf9-00c7d6c06357 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:14 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5" returned: 0 in 0.315s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:14 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 1073741824 Sep 28 12:34:14 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d33a186f-fd7c-4b75-9dfa-209de817a92b tempest-ProjectMemberTests-1684550222 None] Lock "cinder-1c1500f3-ecf3-4212-9ab7-09316d66cc03-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb64c59-6403-4b6e-8644-7c9ade3453b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bc2334-9d4d-4f59-bd61-c7ef73216ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5" released by "delete_volume" :: held 0.902s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c (b742aa9b-9e2a-4b9a-8c42-de0b445bc56c): created successfully Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bc2334-9d4d-4f59-bd61-c7ef73216ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (3f535f1e-2e9a-45ee-b089-991a2ac4af4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-409ec0e6-fb18-437f-bc0f-5ec845668974 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created volume successfully. Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created reservations ['210db22d-07c3-4476-8a98-48022ce0ccdc', 'eb10d018-db1d-4e90-bed2-a55712d65c2e', 'e61ec1ae-1bf8-407c-a1f9-8fa292eb826a', 'd4b1c75a-7e83-43ab-8352-18d8d7648794'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-65df723f-cd71-4667-971d-a9025c5f51d7-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-65df723f-cd71-4667-971d-a9025c5f51d7-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:14 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:14 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-65df723f-cd71-4667-971d-a9025c5f51d7" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-65df723f-cd71-4667-971d-a9025c5f51d7" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc991be-ab54-46df-8c34-4b04d1266727]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:14 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 Sep 28 12:34:14 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:14 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 1073741824" returned: 0 in 0.526s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:14 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.302s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Deleted volume successfully. Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-bb9213e4-63d1-4550-9dc8-bd5f44647f1e tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-86c92b0a-21e2-4f93-95e5-ded9d6fc88b5-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:14 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 Sep 28 12:34:14 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:14 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7" returned: 0 in 0.416s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:14 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7 Sep 28 12:34:14 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:14 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357" returned: 0 in 0.295s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.847s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1169470510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe3ead2-02d2-4f58-a46f-79c941426d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac1c6d2fcd83452e97f61d83d720b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:11Z,use_quota=True,user_id='6128c42195c340729db79fe262e12937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Creating volume fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:14 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de206ecc-a3a1-4d0a-a0fb-175159b448e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:14 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 1073741824 Sep 28 12:34:14 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4566c499-9bf2-4751-a193-c16f84a5ec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 (75917f66-c8d9-4a9d-8cf9-00c7d6c06357): created successfully Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4566c499-9bf2-4751-a193-c16f84a5ec1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (e71182da-5f23-43d8-9f25-56a0fca56701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-70afe634-5e44-4445-9f21-b32f022178c5 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created volume successfully. Sep 28 12:34:15 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-65df723f-cd71-4667-971d-a9025c5f51d7" returned: 0 in 0.278s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-65df723f-cd71-4667-971d-a9025c5f51d7" released by "delete_volume" :: held 0.768s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Created reservations ['83e9f51d-5cd0-4aa7-a6c4-098af8eb599f', '1ffe253c-f634-450c-9292-f5c6fda19da8', 'cc227c3e-b7ea-4989-835e-18daef8b3d10', 'f144e160-98bd-4de7-be4f-733b415fa9bd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:15 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:15 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:15 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 1073741824" returned: 0 in 0.522s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:15 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 Sep 28 12:34:15 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-aca2ab98-0dfa-4060-a0e3-6de21c0042cb-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:15 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.313s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-aca2ab98-0dfa-4060-a0e3-6de21c0042cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-quobyte-1ea8b6c5-0e50-4039-8a03-dc1950743840" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f0108a51-ba08-4334-8850-08029afb6f95 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-65df723f-cd71-4667-971d-a9025c5f51d7-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-1ea8b6c5-0e50-4039-8a03-dc1950743840" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-quobyte-aca2ab98-0dfa-4060-a0e3-6de21c0042cb" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-aca2ab98-0dfa-4060-a0e3-6de21c0042cb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Deleting offline snapshot aca2ab98-0dfa-4060-a0e3-6de21c0042cb of volume 1ea8b6c5-0e50-4039-8a03-dc1950743840 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] snapshot_file for this snap is: volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d01c8de-ab12-4155-8efb-b880b3bcdc76]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:15 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.344s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-81432149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027ade68-4c2a-411c-9fc6-938fbcd34254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5eb94ac0ad445babbe58cfda439b4cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:11Z,use_quota=True,user_id='b14d0853d70a42b697f5a36a9e9f3e2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Creating volume 027ade68-4c2a-411c-9fc6-938fbcd34254 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:15 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:15 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb Sep 28 12:34:15 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:15 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 1073741824 Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a71b4f-c8b4-44d2-b60f-b4d0c9ac698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe3ead2-02d2-4f58-a46f-79c941426d03', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:15 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aec9ce7-8b93-48c8-8e12-cb6d9a1cc04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Volume volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 (fbe3ead2-02d2-4f58-a46f-79c941426d03): created successfully Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aec9ce7-8b93-48c8-8e12-cb6d9a1cc04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Flow 'volume_create_manager' (98d6ab0b-ac95-49ed-975c-b85bd7e8d4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-868ec764-df2b-4936-a22d-745a6d4914ef tempest-VolumeDependencyTests-1484295177 None] Created volume successfully. Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (d2d6533d-8c1f-46d9-8b5a-dce3f64a17ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d8cd55-3b7d-40d7-842a-39a3cf3738db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d8cd55-3b7d-40d7-842a-39a3cf3738db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474385343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481b4c73-61a8-4460-8c32-9128cd901c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:16Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d4fc19-b1aa-404f-820d-670ecf490bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d4fc19-b1aa-404f-820d-670ecf490bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff9a083-fdbf-405a-ba04-9a8997dc1630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff9a083-fdbf-405a-ba04-9a8997dc1630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '481b4c73-61a8-4460-8c32-9128cd901c06', 'volume_name': 'volume-481b4c73-61a8-4460-8c32-9128cd901c06', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab2c4fb-bd14-4ab0-a297-f874e33ce966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab2c4fb-bd14-4ab0-a297-f874e33ce966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5522f816-826f-422d-a8c5-0bbeaa6ef5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Volume 481b4c73-61a8-4460-8c32-9128cd901c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-481b4c73-61a8-4460-8c32-9128cd901c06', 'volume_size': 1} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:16 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb" returned: 0 in 0.504s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea8b6c5-0e50-4039-8a03-dc1950743840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a361d1-b3fa-471d-be80-1e055a481a6c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:16 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 Sep 28 12:34:16 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:16 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 1073741824" returned: 0 in 0.521s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:16 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 Sep 28 12:34:16 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:16 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840" returned: 0 in 0.390s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:16 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb Sep 28 12:34:16 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:16 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254" returned: 0 in 0.268s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1474385343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481b4c73-61a8-4460-8c32-9128cd901c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:16Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Creating volume 481b4c73-61a8-4460-8c32-9128cd901c06 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:16 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be9bc0d-6dea-460f-a8f1-6e8b3c715c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027ade68-4c2a-411c-9fc6-938fbcd34254', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b6339-ecb8-469e-9a15-3778f9db020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:16 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 1073741824 Sep 28 12:34:16 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Volume volume-027ade68-4c2a-411c-9fc6-938fbcd34254 (027ade68-4c2a-411c-9fc6-938fbcd34254): created successfully Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b6339-ecb8-469e-9a15-3778f9db020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Flow 'volume_create_manager' (be3d0428-971f-4507-8001-db265f61bd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3f4b0edb-be4a-47bd-8911-a49c5e5552d6 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created volume successfully. Sep 28 12:34:17 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb" returned: 0 in 0.441s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:17 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb Sep 28 12:34:17 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-027ade68-4c2a-411c-9fc6-938fbcd34254-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-027ade68-4c2a-411c-9fc6-938fbcd34254-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-quobyte-027ade68-4c2a-411c-9fc6-938fbcd34254" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-027ade68-4c2a-411c-9fc6-938fbcd34254" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[966f25a2-57b8-41ef-8c8d-c4c005c03aed]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:17 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 1073741824" returned: 0 in 0.668s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:17 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840.aca2ab98-0dfa-4060-a0e3-6de21c0042cb" returned: 0 in 0.333s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:17 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 Sep 28 12:34:17 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-aca2ab98-0dfa-4060-a0e3-6de21c0042cb" released by "_delete_snapshot" :: held 1.803s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-1ea8b6c5-0e50-4039-8a03-dc1950743840" released by "delete_snapshot" :: held 1.833s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:17 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 Sep 28 12:34:17 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created reservations ['57384164-aa9e-4d72-951a-5772d848f602', 'a24550ac-ca4d-4a7a-a5bb-a499615619a4', 'eeb6dbe8-4a56-4191-90b9-6a0c31afa0ce', '4ba71278-ddcf-491a-a632-8e96d7fa8aee'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Delete snapshot completed successfully. Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-464ad91b-beb2-4ac7-8cb7-02ac513494f5 tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-aca2ab98-0dfa-4060-a0e3-6de21c0042cb-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:17 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254" returned: 0 in 0.423s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:17 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06" returned: 0 in 0.293s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.399s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:17 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254 Sep 28 12:34:17 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-1ea8b6c5-0e50-4039-8a03-dc1950743840-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Creating offline snapshot df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 of volume fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5522f816-826f-422d-a8c5-0bbeaa6ef5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-481b4c73-61a8-4460-8c32-9128cd901c06', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cabed8-c792-4969-bd06-3054ad07921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eca13d-7b6d-4cbd-8c0b-6f4517fcd280]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-1ea8b6c5-0e50-4039-8a03-dc1950743840-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Volume volume-481b4c73-61a8-4460-8c32-9128cd901c06 (481b4c73-61a8-4460-8c32-9128cd901c06): created successfully Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15cabed8-c792-4969-bd06-3054ad07921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (d2d6533d-8c1f-46d9-8b5a-dce3f64a17ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-03170d5b-56a8-47ff-938a-b38f80f088a3 tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "cinder-quobyte-1ea8b6c5-0e50-4039-8a03-dc1950743840" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-1ea8b6c5-0e50-4039-8a03-dc1950743840" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2849bf69-cf77-4d07-b889-48a825c18ce5]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:17 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 Sep 28 12:34:17 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:18 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-027ade68-4c2a-411c-9fc6-938fbcd34254" returned: 0 in 0.322s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-027ade68-4c2a-411c-9fc6-938fbcd34254" released by "delete_volume" :: held 0.824s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:18 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 Sep 28 12:34:18 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created reservations ['4a5efcc6-ca91-4975-a1a3-38bcdf5ead58', 'd61a292f-643d-48e5-bf46-8973c8b85065', '85b16fdd-9bd6-4364-9711-fb2f9f37ea9e', 'bf8fdb54-434d-434d-81d2-5a557e574d59'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:18 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:18 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:18 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03" returned: 0 in 0.477s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:18 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 1G Sep 28 12:34:18 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-75917f66-c8d9-4a9d-8cf9-00c7d6c06357-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:18 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840" returned: 0 in 0.510s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-75917f66-c8d9-4a9d-8cf9-00c7d6c06357-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:18 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840 Sep 28 12:34:18 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-quobyte-75917f66-c8d9-4a9d-8cf9-00c7d6c06357" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-75917f66-c8d9-4a9d-8cf9-00c7d6c06357" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:18 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.368s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Deleted volume successfully. Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae2abb4-d121-4e77-8852-718dfe0f7375]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-5b7d30d4-bb23-4070-be66-febba48b499a tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-027ade68-4c2a-411c-9fc6-938fbcd34254-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:18 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 Sep 28 12:34:18 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:18 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-1ea8b6c5-0e50-4039-8a03-dc1950743840" returned: 0 in 0.321s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-quobyte-1ea8b6c5-0e50-4039-8a03-dc1950743840" released by "delete_volume" :: held 0.906s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Created reservations ['26f812d7-4274-4b02-8da5-75f0559a3f25', '621378e6-aa1f-41a0-a472-1106a3cc0d74', '5451aa52-78db-4cad-bafc-0718b28ede16', 'bcf21b38-1cd3-422a-b7ab-3d5829ae0721'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:18 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 1G" returned: 0 in 0.649s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:19 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 Sep 28 12:34:19 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:19 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:19 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357" returned: 0 in 0.506s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:19 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357 Sep 28 12:34:19 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" returned: 0 in 0.335s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:19 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 is being set with open permissions: ugo+rw Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:19 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 Sep 28 12:34:19 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Deleted volume successfully. Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-784faa89-a4dc-4270-a4ca-ca14a5ed06fd tempest-CreateVolumesFromSnapshotTest-1983480157 None] Lock "cinder-1ea8b6c5-0e50-4039-8a03-dc1950743840-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:19 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-75917f66-c8d9-4a9d-8cf9-00c7d6c06357" returned: 0 in 0.299s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-75917f66-c8d9-4a9d-8cf9-00c7d6c06357" released by "delete_volume" :: held 0.861s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created reservations ['da706aa5-2630-495e-bf3a-d2876dfd4c37', 'f750ac85-18d8-4dfc-a532-472b6b7ce7bd', '4d5e3ec8-357d-458d-bd09-f6b2550dd10b', 'fd48aaed-9f7c-4f46-a7a9-d19fc91fd2cb'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:19 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:19 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:19 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" returned: 0 in 0.301s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:19 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.info Sep 28 12:34:19 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-quobyte-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31e2701-8178-4b70-8ef2-05aa7f2baefc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:19 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.308s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Deleted volume successfully. Sep 28 12:34:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4c9c1039-a301-401f-9513-1cbd4825c8f1 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-75917f66-c8d9-4a9d-8cf9-00c7d6c06357-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:19 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c Sep 28 12:34:19 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.info" returned: 0 in 0.343s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:20 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.info is being set with open permissions: ugo+rw Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:20 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.info Sep 28 12:34:20 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:20 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c" returned: 0 in 0.436s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:20 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.info" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:20 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c Sep 28 12:34:20 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.543s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.843s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot 0e689132-51fe-4201-a606-95e8ce17c364 of volume 481b4c73-61a8-4460-8c32-9128cd901c06 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-35c207a1-acff-4ceb-ace5-477b1a9f5f7e tempest-VolumeDependencyTests-1484295177 None] Create snapshot completed successfully Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cb5e60-a917-4c60-9e89-b261d8cf13bc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:20 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 Sep 28 12:34:20 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:20 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c" released by "delete_volume" :: held 0.804s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created reservations ['08fa4b14-c833-4b4e-a71f-23fd86ed6ad2', '6eaea992-e098-4b5f-89bf-552c7710de80', 'ddf0ba32-fb0d-4faa-891f-f8182beb3ec1', '4529f8cb-6266-4e1a-bddf-d9554e547c4e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:20 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:20 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:20 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06" returned: 0 in 0.513s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:20 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 1G Sep 28 12:34:20 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-74653720-ef94-4391-b33f-07d2358eaef9-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-74653720-ef94-4391-b33f-07d2358eaef9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-quobyte-74653720-ef94-4391-b33f-07d2358eaef9" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-74653720-ef94-4391-b33f-07d2358eaef9" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e32d3-553b-4708-a11d-5b8b2a043639]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:21 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.516s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:21 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Deleted volume successfully. Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-523dbe65-388b-4706-82ba-f0c787bc6c1d tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-b742aa9b-9e2a-4b9a-8c42-de0b445bc56c-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:21 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 Sep 28 12:34:21 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Flow 'volume_create_manager' (c1c9d133-7131-4225-8488-65390951f358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ce1c90-22b6-4187-b394-b60d31625d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ce1c90-22b6-4187-b394-b60d31625d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-866131520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1565034-d9ae-48fc-ba79-f4c4851f3748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac1c6d2fcd83452e97f61d83d720b4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df46dbb8-7e3a-4cc3-8a5a-f8421fe96557,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:21Z,use_quota=True,user_id='6128c42195c340729db79fe262e12937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8946f590-50fe-4110-96d3-c6a2cd8bd4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8946f590-50fe-4110-96d3-c6a2cd8bd4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31e0c02-8e56-4ba8-aca6-08d35355ccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31e0c02-8e56-4ba8-aca6-08d35355ccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b1565034-d9ae-48fc-ba79-f4c4851f3748', 'volume_name': 'volume-b1565034-d9ae-48fc-ba79-f4c4851f3748', 'volume_size': 1, 'snapshot_id': 'df46dbb8-7e3a-4cc3-8a5a-f8421fe96557'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c18b59-8632-4cfa-b80d-370eecbb768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c18b59-8632-4cfa-b80d-370eecbb768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e348c16c-cace-4bfe-9651-25033a9463d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Volume b1565034-d9ae-48fc-ba79-f4c4851f3748: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b1565034-d9ae-48fc-ba79-f4c4851f3748', 'volume_size': 1, 'snapshot_id': 'df46dbb8-7e3a-4cc3-8a5a-f8421fe96557'} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:21 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 1G" returned: 0 in 0.710s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481b4c73-61a8-4460-8c32-9128cd901c06 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:21 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481b4c73-61a8-4460-8c32-9128cd901c06 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 Sep 28 12:34:21 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:21 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9" returned: 0 in 0.570s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:21 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9 Sep 28 12:34:21 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:21 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-481b4c73-61a8-4460-8c32-9128cd901c06 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364" returned: 0 in 0.376s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:21 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 is being set with open permissions: ugo+rw Sep 28 12:34:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:22 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 Sep 28 12:34:22 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:22 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-74653720-ef94-4391-b33f-07d2358eaef9" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-74653720-ef94-4391-b33f-07d2358eaef9" released by "delete_volume" :: held 0.978s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created reservations ['6b64ebcd-4542-4a57-84e5-903ab65ee129', '0c2c2953-dbad-46e6-820c-07bdec5dac06', '5a5492d0-9f73-41ad-9b6d-bc0384b72342', '9fadc78b-3080-4b37-a452-4f40bc149592'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:22 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:22 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:22 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.info Sep 28 12:34:22 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:22 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.273s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Deleted volume successfully. Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9b7bc8cb-1c54-477f-8598-de2689850d85 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-74653720-ef94-4391-b33f-07d2358eaef9-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:22 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.info" returned: 0 in 0.317s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.info is being set with open permissions: ugo+rw Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:22 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.info Sep 28 12:34:22 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:22 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.info" returned: 0 in 0.280s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.371s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-quobyte-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557-b1565034-d9ae-48fc-ba79-f4c4851f3748" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557-b1565034-d9ae-48fc-ba79-f4c4851f3748" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Creating volume b1565034-d9ae-48fc-ba79-f4c4851f3748 from snapshot df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-quobyte-b1565034-d9ae-48fc-ba79-f4c4851f3748" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dd8d412a-c3c3-46bc-b944-4559d50a67d9 tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-b1565034-d9ae-48fc-ba79-f4c4851f3748" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] snapshot: df46dbb8-7e3a-4cc3-8a5a-f8421fe96557, volume: b1565034-d9ae-48fc-ba79-f4c4851f3748, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44b3c8d-6a33-406e-b1c6-454c4253b72b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:23 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 Sep 28 12:34:23 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-2191e3f9-e217-435a-b341-7978e617b154-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-2191e3f9-e217-435a-b341-7978e617b154-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-quobyte-2191e3f9-e217-435a-b341-7978e617b154" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-2191e3f9-e217-435a-b341-7978e617b154" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d3c47-a0e0-4f23-8fb2-3e6a2664ee9e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:23 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" returned: 0 in 0.444s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbe3ead2-02d2-4f58-a46f-79c941426d03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e302f6c-a8b6-437e-8db6-bf5bbedba1f0]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:23 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 Sep 28 12:34:23 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:23 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 Sep 28 12:34:23 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-0e689132-51fe-4201-a606-95e8ce17c364-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-0e689132-51fe-4201-a606-95e8ce17c364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-481b4c73-61a8-4460-8c32-9128cd901c06" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-481b4c73-61a8-4460-8c32-9128cd901c06" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-0e689132-51fe-4201-a606-95e8ce17c364" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-0e689132-51fe-4201-a606-95e8ce17c364" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot 0e689132-51fe-4201-a606-95e8ce17c364 of volume 481b4c73-61a8-4460-8c32-9128cd901c06 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9159a2-1a99-4615-bf7d-fbacddaba6b1]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:23 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154" returned: 0 in 0.482s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:23 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154 Sep 28 12:34:23 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:23 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 Sep 28 12:34:24 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:24 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03" returned: 0 in 0.515s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:24 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 Sep 28 12:34:24 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:24 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-2191e3f9-e217-435a-b341-7978e617b154" returned: 0 in 0.315s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-2191e3f9-e217-435a-b341-7978e617b154" released by "delete_volume" :: held 0.858s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created reservations ['5450916d-f1e8-4872-a882-cedc97abd599', '20060f37-a1c0-4c42-978f-22ccbed1211c', 'ac339be7-bf8b-48fc-baec-0bf74f335c34', '372be822-ddfa-4a66-8b1b-d1e823e0368c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:24 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364" returned: 0 in 0.485s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-481b4c73-61a8-4460-8c32-9128cd901c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb108e7-216f-4a99-990f-4227416dd248]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-d90b004f-162a-4e97-a747-43f9c41854e7-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:24 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:24 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-d90b004f-162a-4e97-a747-43f9c41854e7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "cinder-quobyte-d90b004f-162a-4e97-a747-43f9c41854e7" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-d90b004f-162a-4e97-a747-43f9c41854e7" acquired by "delete_volume" :: waited 0.027s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:24 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 Sep 28 12:34:24 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62d2418-f3e6-48aa-afb6-eb4a741b2dcc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:24 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 Sep 28 12:34:24 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:25 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.614s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:25 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:25 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Deleted volume successfully. Sep 28 12:34:25 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-821eb877-7406-4c82-8537-ace44792f2d8 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-2191e3f9-e217-435a-b341-7978e617b154-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:25 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06" returned: 0 in 1.035s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:25 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7" returned: 0 in 0.814s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:25 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 Sep 28 12:34:25 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:25 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7 Sep 28 12:34:25 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:26 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-d90b004f-162a-4e97-a747-43f9c41854e7" returned: 0 in 0.753s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:26 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364" returned: 0 in 0.825s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-quobyte-d90b004f-162a-4e97-a747-43f9c41854e7" released by "delete_volume" :: held 1.668s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:26 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364 Sep 28 12:34:26 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Created reservations ['e251c3ad-aef0-47c7-8337-1060f3703483', '3542e4b6-f338-4626-8397-52713c33c34c', 'bc95aa61-7526-45c4-8a97-551bb206e941', '8a552293-4ce3-4ab3-97ea-da1cf9fe6f88'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:26 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:26 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:27 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06.0e689132-51fe-4201-a606-95e8ce17c364" returned: 0 in 0.812s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-0e689132-51fe-4201-a606-95e8ce17c364" released by "_delete_snapshot" :: held 3.349s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-481b4c73-61a8-4460-8c32-9128cd901c06" released by "delete_snapshot" :: held 3.402s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:27 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:27 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.698s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:27 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Deleted volume successfully. Sep 28 12:34:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-1e84d9a5-437b-4843-9232-2b7330ce07b0 tempest-CreateVolumesFromSourceVolumeTest-2123000169 None] Lock "cinder-d90b004f-162a-4e97-a747-43f9c41854e7-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:27 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Created reservations ['5aae2f1d-d1ab-4195-ac35-f1ec7073cae6', '0d03c388-d0c7-40d1-9a24-f33bae603cf2', '23020ee0-d360-4977-a3a9-e0eaa51254c8', '12052867-f4ec-4410-a034-8708ecd03748'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:27 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:34:27 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9add5f55-13f5-478c-bbbd-50d4f6841046 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-0e689132-51fe-4201-a606-95e8ce17c364-delete_snapshot" released by "delete_snapshot" :: held 3.775s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-481b4c73-61a8-4460-8c32-9128cd901c06-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-481b4c73-61a8-4460-8c32-9128cd901c06-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-481b4c73-61a8-4460-8c32-9128cd901c06" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-481b4c73-61a8-4460-8c32-9128cd901c06" acquired by "delete_volume" :: waited 0.056s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[354eae0c-2f62-432e-95e0-0b8e3a01f525]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:28 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 Sep 28 12:34:28 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Flow 'volume_create_manager' (bf1c54e7-f901-4629-8e84-717355f314dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ff71af-a374-4c89-8da9-6f4f771ec48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ff71af-a374-4c89-8da9-6f4f771ec48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf109674-f3de-4622-8beb-2a77e1685fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26620b54d52146aa91102bc1318f84c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:29Z,use_quota=True,user_id='00cda5ac28a4411ba69873717a240208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57d6da1-c711-4ee1-a8fd-ef3cebd27cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57d6da1-c711-4ee1-a8fd-ef3cebd27cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f439953-605b-452e-86be-8674e4dbbd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:28 devstack cinder-volume[87167]: DEBUG cinder.image.glance [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Creating Keystone auth plugin from conf {{(pid=87167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:34:29 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06" returned: 0 in 0.869s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:29 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:29 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06 Sep 28 12:34:29 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f439953-605b-452e-86be-8674e4dbbd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf109674-f3de-4622-8beb-2a77e1685fce', 'volume_name': 'volume-cf109674-f3de-4622-8beb-2a77e1685fce', 'volume_size': 1, 'image_id': '883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21426541ee04f9c26fde5b4f230b7cbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26620b54d52146aa91102bc1318f84c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ee60806d41490196e36e7e9c10babf9f4f6e0e9833bd613f49bcbe68315d93c370c2b72c990a4093cf5178497ef98cb7a1a38076f2093fa18c39ced357da087', 'id': '883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'created_at': datetime.datetime(2026, 9, 28, 10, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff92850c-ebee-4483-a923-13ce42e5db65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff92850c-ebee-4483-a923-13ce42e5db65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:29 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e30688-9b8f-41d0-9c6e-5c23fb3645da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:29 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Volume cf109674-f3de-4622-8beb-2a77e1685fce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf109674-f3de-4622-8beb-2a77e1685fce', 'volume_size': 1, 'image_id': '883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21426541ee04f9c26fde5b4f230b7cbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26620b54d52146aa91102bc1318f84c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ee60806d41490196e36e7e9c10babf9f4f6e0e9833bd613f49bcbe68315d93c370c2b72c990a4093cf5178497ef98cb7a1a38076f2093fa18c39ced357da087', 'id': '883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'created_at': datetime.datetime(2026, 9, 28, 10, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7/file', 'properties': {}}, 'image_service': } Sep 28 12:34:29 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Trying to clone cf109674-f3de-4622-8beb-2a77e1685fce from image 883b5feb-fd7a-40e9-b307-b0ffce5554a7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'metadata': {}}]). {{(pid=87167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:34:30 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:34:30 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-481b4c73-61a8-4460-8c32-9128cd901c06" returned: 0 in 0.840s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-481b4c73-61a8-4460-8c32-9128cd901c06" released by "delete_volume" :: held 1.943s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f33ff-85c1-40f5-808b-f0eb280f6935]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Created reservations ['2b250f56-ccb0-4e9a-98ac-d5ffef05d1b1', 'fe70ab80-63e9-483b-af20-5c1e5ca27903', '8e83ca99-99ff-455d-ab42-42b7ced84ea1', 'e90911ba-913f-47e1-ba33-7ba3e385a65b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:30 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD Sep 28 12:34:30 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:30 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:30 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:31 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD" returned: 0 in 0.803s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:31 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.495s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:31 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:34:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7e110c17-2cfa-4eec-bdfd-ef95a41fe8d4 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-481b4c73-61a8-4460-8c32-9128cd901c06-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:31 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD Sep 28 12:34:31 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:31 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD" returned: 1 in 0.660s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:34:31 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Temporary image 883b5feb-fd7a-40e9-b307-b0ffce5554a7 is fetched for user 00cda5ac28a4411ba69873717a240208. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:34:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46d8b93-1fb2-4f68-b00b-338175524c2a]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:32 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD Sep 28 12:34:32 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:32 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD" returned: 0 in 0.827s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:32 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:32 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (69f7633d-aec8-4f25-9149-1cbe905242bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3619c1-f934-465e-8496-8554151e45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3619c1-f934-465e-8496-8554151e45f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436851590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0c401c-d735-4ee1-983b-2f9410b65f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:33Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3918ac4b-8779-4eaa-b698-7e4d62d809dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3918ac4b-8779-4eaa-b698-7e4d62d809dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0baeb3-a2dd-4972-a23b-2dfa64c8de02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0baeb3-a2dd-4972-a23b-2dfa64c8de02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0c401c-d735-4ee1-983b-2f9410b65f06', 'volume_name': 'volume-6c0c401c-d735-4ee1-983b-2f9410b65f06', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d413fb-ea53-4d53-9622-4c145e867a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d413fb-ea53-4d53-9622-4c145e867a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5faa1a38-1a2a-4924-8a6b-45be5f9a6dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Volume 6c0c401c-d735-4ee1-983b-2f9410b65f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0c401c-d735-4ee1-983b-2f9410b65f06', 'volume_size': 1} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:33 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD Sep 28 12:34:33 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:33 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748" returned: 0 in 9.411s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:34:33 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Converted 1024.00 MB image at 108.80 MB/s Sep 28 12:34:33 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 is being set with open permissions: ugo+rw Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:33 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 Sep 28 12:34:33 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:33 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD" returned: 1 in 0.633s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:33 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748" returned: 0 in 0.238s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-b1565034-d9ae-48fc-ba79-f4c4851f3748" released by "_copy_volume_from_snapshot" :: held 10.709s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557-b1565034-d9ae-48fc-ba79-f4c4851f3748" released by "_create_volume_from_snapshot" :: held 10.781s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.805s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1436851590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0c401c-d735-4ee1-983b-2f9410b65f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:33Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Creating volume 6c0c401c-d735-4ee1-983b-2f9410b65f06 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:33 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 1073741824 Sep 28 12:34:33 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e348c16c-cace-4bfe-9651-25033a9463d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1565034-d9ae-48fc-ba79-f4c4851f3748', 'volume_size': 1, 'snapshot_id': 'df46dbb8-7e3a-4cc3-8a5a-f8421fe96557'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d42546-e736-4175-9f1c-5d1606ab04fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Volume volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 (b1565034-d9ae-48fc-ba79-f4c4851f3748): created successfully Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d42546-e736-4175-9f1c-5d1606ab04fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Flow 'volume_create_manager' (c1c9d133-7131-4225-8488-65390951f358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0c01dc4c-fd9e-4cb7-ae5c-f8393cf6d196 tempest-VolumeDependencyTests-1484295177 None] Created volume successfully. Sep 28 12:34:34 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 1073741824" returned: 0 in 0.475s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:34 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 Sep 28 12:34:34 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:34 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06" returned: 0 in 0.258s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf109674-f3de-4622-8beb-2a77e1685fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26620b54d52146aa91102bc1318f84c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:29Z,use_quota=True,user_id='00cda5ac28a4411ba69873717a240208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Creating volume cf109674-f3de-4622-8beb-2a77e1685fce {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:34 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:34 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce 1073741824 Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5faa1a38-1a2a-4924-8a6b-45be5f9a6dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0c401c-d735-4ee1-983b-2f9410b65f06', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:34 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e4c664-47a4-471c-af64-49a614b6d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Volume volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 (6c0c401c-d735-4ee1-983b-2f9410b65f06): created successfully Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e4c664-47a4-471c-af64-49a614b6d03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (69f7633d-aec8-4f25-9149-1cbe905242bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-74d73d0c-951f-4310-9798-b45814b9a992 tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-quobyte-fbe3ead2-02d2-4f58-a46f-79c941426d03" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-fbe3ead2-02d2-4f58-a46f-79c941426d03" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-quobyte-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Deleting offline snapshot df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 of volume fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] snapshot_file for this snap is: volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[501427ba-59c0-40f5-929e-1d0519f8fbd9]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:35 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce 1073741824" returned: 0 in 0.532s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:35 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 Sep 28 12:34:35 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:35 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce Sep 28 12:34:35 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:35 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce" returned: 0 in 0.282s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:35 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" returned: 0 in 0.417s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbe3ead2-02d2-4f58-a46f-79c941426d03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Attempting download of 883b5feb-fd7a-40e9-b307-b0ffce5554a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'metadata': {}}])) to volume cf109674-f3de-4622-8beb-2a77e1685fce. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a08d53-50ed-4833-b910-6514f3a19bad]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f6356b-25ae-4eaf-9fa0-1a025a8cf48a]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_883b5feb-fd7a-40e9-b307-b0ffce5554a7_0jwirmk9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:35 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 Sep 28 12:34:35 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:35 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_883b5feb-fd7a-40e9-b307-b0ffce5554a7_0jwirmk9 Sep 28 12:34:35 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot cc97b331-c519-46ba-afa2-285e4b2e3101 of volume 6c0c401c-d735-4ee1-983b-2f9410b65f06 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[02973328-4556-47f5-9880-abd32d99f6c2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:35 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_883b5feb-fd7a-40e9-b307-b0ffce5554a7_0jwirmk9" returned: 0 in 0.453s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_883b5feb-fd7a-40e9-b307-b0ffce5554a7_0jwirmk9 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 Sep 28 12:34:36 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_883b5feb-fd7a-40e9-b307-b0ffce5554a7_0jwirmk9 Sep 28 12:34:36 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03" returned: 0 in 0.678s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 Sep 28 12:34:36 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_883b5feb-fd7a-40e9-b307-b0ffce5554a7_0jwirmk9" returned: 1 in 0.443s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_883b5feb-fd7a-40e9-b307-b0ffce5554a7_0jwirmk9' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06" returned: 0 in 0.465s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[628aedf2-e92e-4d20-beed-9680c1d40e66]: (4, 'raw') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 1G Sep 28 12:34:36 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD Sep 28 12:34:36 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" returned: 0 in 0.479s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557 Sep 28 12:34:36 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03.df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" returned: 0 in 0.361s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 1G" returned: 0 in 0.584s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD Sep 28 12:34:37 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:37 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 Sep 28 12:34:37 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557" released by "_delete_snapshot" :: held 2.109s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-fbe3ead2-02d2-4f58-a46f-79c941426d03" released by "delete_snapshot" :: held 2.140s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Created reservations ['9fadd049-c659-4e1a-9e71-725ac743af2e', 'adb5df12-0395-48e8-8c69-4c5adb7f75bb', '1ce57d44-434b-4ef4-a411-ebb90e1128dc', 'cb817021-4073-4a20-aedb-ebf4f57cf541'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Delete snapshot completed successfully. Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-4de39f26-2637-465d-9abc-245393ba4b04 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-df46dbb8-7e3a-4cc3-8a5a-f8421fe96557-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:37 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD' failed. Not Retrying. {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] 883b5feb-fd7a-40e9-b307-b0ffce5554a7 was raw, converting to qcow2 {{(pid=87167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101" returned: 0 in 0.340s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 is being set with open permissions: ugo+rw Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce Sep 28 12:34:37 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:37 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 Sep 28 12:34:37 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:37 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101" returned: 0 in 0.266s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.info Sep 28 12:34:37 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:37 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce" returned: 0 in 0.519s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_883b5feb-fd7a-40e9-b307-b0ffce5554a7_9w2t6mx4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:34:37 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce 1G Sep 28 12:34:37 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:37 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.info" returned: 0 in 0.274s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.info is being set with open permissions: ugo+rw Sep 28 12:34:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.info Sep 28 12:34:37 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-fbe3ead2-02d2-4f58-a46f-79c941426d03-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:38 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.info" returned: 0 in 0.304s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-fbe3ead2-02d2-4f58-a46f-79c941426d03-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:38 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce 1G" returned: 0 in 0.420s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Downloaded image 883b5feb-fd7a-40e9-b307-b0ffce5554a7 ((None, [{'url': 'file:///opt/stack/data/glance/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'metadata': {}}])) to volume cf109674-f3de-4622-8beb-2a77e1685fce successfully. {{(pid=87167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Temporary image 883b5feb-fd7a-40e9-b307-b0ffce5554a7 for user 00cda5ac28a4411ba69873717a240208 is deleted. {{(pid=87167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.volume.volume_utils [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Marking volume cf109674-f3de-4622-8beb-2a77e1685fce as bootable. {{(pid=87167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:34:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-076690a5-4a82-4536-9037-ffd1fd91de37 tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Copying metadata from image 883b5feb-fd7a-40e9-b307-b0ffce5554a7 to cf109674-f3de-4622-8beb-2a77e1685fce. {{(pid=87167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Creating volume glance metadata for volume cf109674-f3de-4622-8beb-2a77e1685fce backed by image 883b5feb-fd7a-40e9-b307-b0ffce5554a7 with: {'image_id': '883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '21426541ee04f9c26fde5b4f230b7cbc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-quobyte-fbe3ead2-02d2-4f58-a46f-79c941426d03" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-fbe3ead2-02d2-4f58-a46f-79c941426d03" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5bfdd-fef4-4fa6-baa1-80fda907aada]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e30688-9b8f-41d0-9c6e-5c23fb3645da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf109674-f3de-4622-8beb-2a77e1685fce', 'volume_size': 1, 'image_id': '883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21426541ee04f9c26fde5b4f230b7cbc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26620b54d52146aa91102bc1318f84c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ee60806d41490196e36e7e9c10babf9f4f6e0e9833bd613f49bcbe68315d93c370c2b72c990a4093cf5178497ef98cb7a1a38076f2093fa18c39ced357da087', 'id': '883b5feb-fd7a-40e9-b307-b0ffce5554a7', 'created_at': datetime.datetime(2026, 9, 28, 10, 34, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 34, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/883b5feb-fd7a-40e9-b307-b0ffce5554a7/file', 'properties': {}}, 'image_service': }' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4d6e12-5b0c-4b4e-8196-c4277feed611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Volume volume-cf109674-f3de-4622-8beb-2a77e1685fce (cf109674-f3de-4622-8beb-2a77e1685fce): created successfully Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4d6e12-5b0c-4b4e-8196-c4277feed611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Flow 'volume_create_manager' (bf1c54e7-f901-4629-8e84-717355f314dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-61aa6586-8099-49da-9cbf-dc5f726c7934 tempest-VolumeImageDependencyTests-1147271223 None] Created volume successfully. Sep 28 12:34:38 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 Sep 28 12:34:38 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:38 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03" returned: 0 in 0.405s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:38 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03 Sep 28 12:34:38 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:39 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fbe3ead2-02d2-4f58-a46f-79c941426d03" returned: 0 in 0.303s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-fbe3ead2-02d2-4f58-a46f-79c941426d03" released by "delete_volume" :: held 0.785s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-cc97b331-c519-46ba-afa2-285e4b2e3101-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-cc97b331-c519-46ba-afa2-285e4b2e3101-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-6c0c401c-d735-4ee1-983b-2f9410b65f06" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-6c0c401c-d735-4ee1-983b-2f9410b65f06" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-cc97b331-c519-46ba-afa2-285e4b2e3101" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Created reservations ['44359e61-9c27-440b-bd8a-0e56dba05a1b', '35676d0b-937b-4a21-af9a-54dcc3eae244', 'c8dc0432-9951-4bd5-b561-f929993572ef', '9683a74d-0ebf-401b-8648-dce1ccd41f9b'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-cc97b331-c519-46ba-afa2-285e4b2e3101" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot cc97b331-c519-46ba-afa2-285e4b2e3101 of volume 6c0c401c-d735-4ee1-983b-2f9410b65f06 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b57dd2-9b37-4f3e-867e-e2c95e7b2242]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:39 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:39 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:39 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 Sep 28 12:34:39 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-b1565034-d9ae-48fc-ba79-f4c4851f3748-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-b1565034-d9ae-48fc-ba79-f4c4851f3748-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "cinder-quobyte-b1565034-d9ae-48fc-ba79-f4c4851f3748" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-b1565034-d9ae-48fc-ba79-f4c4851f3748" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2834e0a4-13d4-453a-9084-4fa007355408]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:39 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.298s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Deleted volume successfully. Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-3c1365fb-9039-4bee-bc70-d1d8e94d4436 tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-fbe3ead2-02d2-4f58-a46f-79c941426d03-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:39 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 Sep 28 12:34:39 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:39 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101" returned: 0 in 0.434s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c0c401c-d735-4ee1-983b-2f9410b65f06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Acquiring lock "cinder-cf109674-f3de-4622-8beb-2a77e1685fce-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd034fe-c5df-453d-96c2-73545d5c3326]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Lock "cinder-cf109674-f3de-4622-8beb-2a77e1685fce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Acquiring lock "cinder-quobyte-cf109674-f3de-4622-8beb-2a77e1685fce" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Lock "cinder-quobyte-cf109674-f3de-4622-8beb-2a77e1685fce" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7c0dd7-a74a-44f1-810a-f2d416ffa20c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:39 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 Sep 28 12:34:39 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:39 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748" returned: 0 in 0.457s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:40 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce Sep 28 12:34:40 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:40 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748 Sep 28 12:34:40 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:40 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06" returned: 0 in 0.520s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:40 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 Sep 28 12:34:40 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:40 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:40 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce" returned: 0 in 0.460s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b1565034-d9ae-48fc-ba79-f4c4851f3748" returned: 0 in 0.342s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-quobyte-b1565034-d9ae-48fc-ba79-f4c4851f3748" released by "delete_volume" :: held 0.861s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:40 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce Sep 28 12:34:40 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Created reservations ['4767388c-144e-40ea-98a8-3e8c3867824c', 'd6cedfb8-461b-4536-894b-db44dfb0fe90', 'debff086-7c6a-43b2-96a8-2a570be49d82', '63c70c39-b117-49b6-b001-94bc542a710c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:40 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:40 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:40 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-cf109674-f3de-4622-8beb-2a77e1685fce" returned: 0 in 0.339s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Lock "cinder-quobyte-cf109674-f3de-4622-8beb-2a77e1685fce" released by "delete_volume" :: held 0.862s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:40 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101" returned: 0 in 0.470s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Created reservations ['7f805afe-a663-4004-97ef-ffead0463d83', 'f9dd2907-e1f3-4df6-b0d3-462d2fb77825', '7e8dd915-1a56-4cea-8d18-32d8da1a07e6', 'ff85f697-898d-4bdc-a394-cfa2203f45b7'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:40 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101 Sep 28 12:34:40 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:41 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.457s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:41 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:41 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Deleted volume successfully. Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-d74f342c-4910-4efb-a616-0d0aced23e7c tempest-VolumeDependencyTests-1484295177 None] Lock "cinder-b1565034-d9ae-48fc-ba79-f4c4851f3748-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:41 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06.cc97b331-c519-46ba-afa2-285e4b2e3101" returned: 0 in 0.581s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:41 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.380s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-cc97b331-c519-46ba-afa2-285e4b2e3101" released by "_delete_snapshot" :: held 2.143s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Deleted volume successfully. Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-6c0c401c-d735-4ee1-983b-2f9410b65f06" released by "delete_snapshot" :: held 2.176s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ddfe6713-8b6b-4575-89f9-934d3c6fcc1b tempest-VolumeImageDependencyTests-1147271223 None] Lock "cinder-cf109674-f3de-4622-8beb-2a77e1685fce-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Created reservations ['61550e56-227a-4578-8645-2bc7d769cece', '50c41da8-1549-430e-90e5-90fee8cb57e0', '6aa3e0a6-afdc-4ef3-b6ed-fe7f485df961', '3e70b028-71dd-4b69-9753-c6c8b8f0c4f0'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:34:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9198044a-d04f-4387-8640-3f1a2f052373 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-cc97b331-c519-46ba-afa2-285e4b2e3101-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-6c0c401c-d735-4ee1-983b-2f9410b65f06-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-6c0c401c-d735-4ee1-983b-2f9410b65f06-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-6c0c401c-d735-4ee1-983b-2f9410b65f06" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:42 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-6c0c401c-d735-4ee1-983b-2f9410b65f06" acquired by "delete_volume" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:42 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbb0fe7-f6e0-4f23-a49b-f752265149c4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:42 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 Sep 28 12:34:42 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:43 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06" returned: 0 in 0.484s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:43 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06 Sep 28 12:34:43 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:43 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-6c0c401c-d735-4ee1-983b-2f9410b65f06" returned: 0 in 0.313s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-6c0c401c-d735-4ee1-983b-2f9410b65f06" released by "delete_volume" :: held 0.910s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Created reservations ['a1e936a7-694c-4ddc-a4f9-3d1b33104eb4', 'e146bbf8-5feb-42da-a167-1487137c075c', 'cf8ed38f-6d0c-414e-8859-02b49c24c3a2', 'c4d35eb7-77e8-4935-8cb8-f871f8843b4e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:43 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:43 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:43 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:43 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:34:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c0799b78-eadc-4446-914b-56d6b1e5dea6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-6c0c401c-d735-4ee1-983b-2f9410b65f06-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Flow 'volume_create_manager' (8270906e-9851-4cf6-969b-2a51fe496af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21598837-192d-479a-9405-fe63c9b255d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21598837-192d-479a-9405-fe63c9b255d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e1b507-dfb6-42c4-88c7-233dbcc70a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3279bb9ec9b8486e8ad79bd894608edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:45Z,use_quota=True,user_id='b820738984d54cb8adee1df3f3d6b1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c179d498-1241-4536-9337-4fc888c4b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c179d498-1241-4536-9337-4fc888c4b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aafb761-495f-4264-a32e-72508845ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aafb761-495f-4264-a32e-72508845ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e1b507-dfb6-42c4-88c7-233dbcc70a38', 'volume_name': 'volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82377d93-4933-42b1-9771-dbed3a58acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82377d93-4933-42b1-9771-dbed3a58acb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a827f415-48c2-40e2-873f-9481aabe264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Volume c1e1b507-dfb6-42c4-88c7-233dbcc70a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38', 'volume_size': 1} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e1b507-dfb6-42c4-88c7-233dbcc70a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3279bb9ec9b8486e8ad79bd894608edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:45Z,use_quota=True,user_id='b820738984d54cb8adee1df3f3d6b1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Creating volume c1e1b507-dfb6-42c4-88c7-233dbcc70a38 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:45 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:45 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 1073741824 Sep 28 12:34:45 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (befb8162-77a4-4609-9386-03d103a39369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05277a5b-655c-4f3c-acb5-f287b65137a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05277a5b-655c-4f3c-acb5-f287b65137a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1731423003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dedbd5-c1a7-46c4-a50f-0c7a37c1b077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:45Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434d4cd2-007e-4f41-b3e0-c8a9c9819645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434d4cd2-007e-4f41-b3e0-c8a9c9819645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b172aa44-c0d7-4007-956c-94b35c1d3adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b172aa44-c0d7-4007-956c-94b35c1d3adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35dedbd5-c1a7-46c4-a50f-0c7a37c1b077', 'volume_name': 'volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74d23d0-61fd-4a39-9d1d-265405411bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74d23d0-61fd-4a39-9d1d-265405411bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370d2cc8-7ac3-41c4-a234-1e7178959115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:45 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Volume 35dedbd5-c1a7-46c4-a50f-0c7a37c1b077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077', 'volume_size': 1} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:45 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 1073741824" returned: 0 in 0.551s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=251,cinder:UPDATE=295,cinder:INSERT=92,cinder:DELETE=34 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=228,cinder:UPDATE=348,cinder:INSERT=82,cinder:DELETE=22 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:34:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:45 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 Sep 28 12:34:45 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:46 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38" returned: 0 in 0.254s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1731423003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dedbd5-c1a7-46c4-a50f-0c7a37c1b077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:45Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Creating volume 35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:46 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a827f415-48c2-40e2-873f-9481aabe264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e2ae0d-c71e-47b9-9cca-d1eb1ade9386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:46 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 1073741824 Sep 28 12:34:46 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Volume volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 (c1e1b507-dfb6-42c4-88c7-233dbcc70a38): created successfully Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e2ae0d-c71e-47b9-9cca-d1eb1ade9386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Flow 'volume_create_manager' (8270906e-9851-4cf6-969b-2a51fe496af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0395fbd2-5f74-4030-99bd-83cb9b7e755e tempest-CinderUnicodeTest-1151444630 None] Created volume successfully. Sep 28 12:34:46 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 1073741824" returned: 0 in 0.503s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:46 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 Sep 28 12:34:46 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:46 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" returned: 0 in 0.301s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370d2cc8-7ac3-41c4-a234-1e7178959115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3345e235-4d45-4035-b857-15b1e66e1fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:46 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Volume volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 (35dedbd5-c1a7-46c4-a50f-0c7a37c1b077): created successfully Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3345e235-4d45-4035-b857-15b1e66e1fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:46 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (befb8162-77a4-4609-9386-03d103a39369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-272561d4-6b05-45d8-8a2b-9b5b4eef3185 tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:34:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot 0a9a8296-d77d-46d2-88c8-1e16fce8cc30 of volume 35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:47 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc5b9f7-df3c-42d8-a253-d63c40dc9f64]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:47 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 Sep 28 12:34:47 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Flow 'volume_create_manager' (974930c1-c408-4279-b0ba-7ccf7bab512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95ca5e6-717e-4f6a-bf51-81d54d7f4e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95ca5e6-717e-4f6a-bf51-81d54d7f4e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-185169330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7071196-032a-4b27-a8ae-407c37465f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3279bb9ec9b8486e8ad79bd894608edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:48Z,use_quota=True,user_id='b820738984d54cb8adee1df3f3d6b1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09cff55-d424-4f47-8d75-b2569dfa1062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09cff55-d424-4f47-8d75-b2569dfa1062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab30d69-7457-4aa9-ae66-150505af552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab30d69-7457-4aa9-ae66-150505af552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7071196-032a-4b27-a8ae-407c37465f08', 'volume_name': 'volume-b7071196-032a-4b27-a8ae-407c37465f08', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e48243-b3fd-4d9d-9ab4-ab259ce8a128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2e48243-b3fd-4d9d-9ab4-ab259ce8a128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a390e395-c279-4004-b782-b38a5c498f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Volume b7071196-032a-4b27-a8ae-407c37465f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7071196-032a-4b27-a8ae-407c37465f08', 'volume_size': 1} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:48 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" returned: 0 in 0.603s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:48 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 1G Sep 28 12:34:48 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:48 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 1G" returned: 0 in 0.388s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:48 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 Sep 28 12:34:48 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:48 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30" returned: 0 in 0.329s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:48 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 is being set with open permissions: ugo+rw Sep 28 12:34:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:49 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 Sep 28 12:34:49 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:49 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30" returned: 0 in 0.284s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:49 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.info Sep 28 12:34:49 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:49 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.info" returned: 0 in 0.287s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:49 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.info is being set with open permissions: ugo+rw Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:49 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:49 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:49 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.info Sep 28 12:34:49 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:49 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.325s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:34:49 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.info" returned: 0 in 0.344s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-185169330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7071196-032a-4b27-a8ae-407c37465f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3279bb9ec9b8486e8ad79bd894608edd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:48Z,use_quota=True,user_id='b820738984d54cb8adee1df3f3d6b1d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Creating volume b7071196-032a-4b27-a8ae-407c37465f08 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:49 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:50 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 1073741824 Sep 28 12:34:50 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8160fdf3-bf54-45b4-80ef-55655e12c4d1 tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:34:50 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 1073741824" returned: 0 in 0.559s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:50 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 Sep 28 12:34:50 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:50 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08" returned: 0 in 0.309s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a390e395-c279-4004-b782-b38a5c498f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7071196-032a-4b27-a8ae-407c37465f08', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e39a82d-fc43-4e45-ba19-71f77c96b36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:50 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Volume volume-b7071196-032a-4b27-a8ae-407c37465f08 (b7071196-032a-4b27-a8ae-407c37465f08): created successfully Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e39a82d-fc43-4e45-ba19-71f77c96b36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:50 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Flow 'volume_create_manager' (974930c1-c408-4279-b0ba-7ccf7bab512a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:50 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-70a1198d-bc18-4fe9-860e-b5f02691cafc tempest-CinderUnicodeTest-1151444630 None] Created volume successfully. Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-0a9a8296-d77d-46d2-88c8-1e16fce8cc30-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-0a9a8296-d77d-46d2-88c8-1e16fce8cc30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-0a9a8296-d77d-46d2-88c8-1e16fce8cc30" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-0a9a8296-d77d-46d2-88c8-1e16fce8cc30" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot 0a9a8296-d77d-46d2-88c8-1e16fce8cc30 of volume 35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a00c9-7b16-4f5d-a35b-d251cb94d8a7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:51 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 Sep 28 12:34:51 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Creating offline snapshot 887e0e78-432f-40ba-9db9-fc2ff9e4bf6c of volume b7071196-032a-4b27-a8ae-407c37465f08 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7c8329-e766-4ac4-8bef-b70b0a3f4649]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:51 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30" returned: 0 in 0.617s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca24885-4ea5-4677-988c-a15d0d71bf80]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:51 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 Sep 28 12:34:51 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:51 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 Sep 28 12:34:51 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:52 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08" returned: 0 in 0.460s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:52 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c 1G Sep 28 12:34:52 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:52 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" returned: 0 in 0.472s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:52 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 Sep 28 12:34:52 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:52 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c 1G" returned: 0 in 0.535s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7071196-032a-4b27-a8ae-407c37465f08 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:52 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7071196-032a-4b27-a8ae-407c37465f08 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c Sep 28 12:34:52 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:52 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30" returned: 0 in 0.502s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:52 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30 Sep 28 12:34:52 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:53 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7071196-032a-4b27-a8ae-407c37465f08 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c" returned: 0 in 0.406s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:53 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c is being set with open permissions: ugo+rw Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:53 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c Sep 28 12:34:53 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:53 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077.0a9a8296-d77d-46d2-88c8-1e16fce8cc30" returned: 0 in 0.398s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-0a9a8296-d77d-46d2-88c8-1e16fce8cc30" released by "_delete_snapshot" :: held 2.173s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" released by "delete_snapshot" :: held 2.207s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Created reservations ['6f6b3868-75c4-4c12-8010-c1d51ab42adb', 'feb581fa-b0e3-44cb-b05f-de5b4522df3a', '69708e27-95f6-4e4f-91d5-e83f7b60e2e9', 'a638dfab-1306-4ed3-bd79-ca9e1021fd82'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:53 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-e6555159-cd34-413b-ae64-c41bbe3d1f99 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-0a9a8296-d77d-46d2-88c8-1e16fce8cc30-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:53 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c" returned: 0 in 0.367s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:53 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.info Sep 28 12:34:53 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:53 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.info" returned: 0 in 0.308s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:53 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.info is being set with open permissions: ugo+rw Sep 28 12:34:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:53 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.info Sep 28 12:34:53 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:54 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.info" returned: 0 in 0.291s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d4dfa8d8-9b30-4700-9b1b-022eb1d4f4f3 tempest-CinderUnicodeTest-1151444630 None] Create snapshot completed successfully Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f19d7db-8f20-4778-99d2-7df1995dcd1e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:54 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 Sep 28 12:34:54 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "cinder-887e0e78-432f-40ba-9db9-fc2ff9e4bf6c-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:54 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" returned: 0 in 0.549s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-887e0e78-432f-40ba-9db9-fc2ff9e4bf6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "cinder-quobyte-b7071196-032a-4b27-a8ae-407c37465f08" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:55 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077 Sep 28 12:34:55 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-quobyte-b7071196-032a-4b27-a8ae-407c37465f08" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "cinder-quobyte-887e0e78-432f-40ba-9db9-fc2ff9e4bf6c" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-quobyte-887e0e78-432f-40ba-9db9-fc2ff9e4bf6c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Deleting offline snapshot 887e0e78-432f-40ba-9db9-fc2ff9e4bf6c of volume b7071196-032a-4b27-a8ae-407c37465f08 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] snapshot_file for this snap is: volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cff71e-a39c-482e-bc7f-839d13a6f07a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:55 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c Sep 28 12:34:55 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:55 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" returned: 0 in 0.408s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077" released by "delete_volume" :: held 1.046s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Created reservations ['b589597d-218b-42ad-a476-9a37374dd769', '3199b9ca-04da-4212-a1c8-f7ca3a672c05', '471282f2-d3dd-409c-bea6-e0c1f87a5a62', '8e0a9fe2-2003-4f48-ad24-a15f4b4b63e3'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:55 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c" returned: 0 in 0.526s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7071196-032a-4b27-a8ae-407c37465f08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:55 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:55 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4249375e-647c-4a7d-be74-d0eeaad7b445]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:55 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 Sep 28 12:34:55 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:56 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.386s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:56 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:34:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dec7924c-7796-4d15-a14a-d9dbd0b1788d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-35dedbd5-c1a7-46c4-a50f-0c7a37c1b077-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:56 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08" returned: 0 in 0.505s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:56 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c Sep 28 12:34:56 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:56 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c" returned: 0 in 0.428s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:56 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c Sep 28 12:34:56 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:57 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08.887e0e78-432f-40ba-9db9-fc2ff9e4bf6c" returned: 0 in 0.394s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-quobyte-887e0e78-432f-40ba-9db9-fc2ff9e4bf6c" released by "_delete_snapshot" :: held 2.069s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-quobyte-b7071196-032a-4b27-a8ae-407c37465f08" released by "delete_snapshot" :: held 2.108s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (d636330f-b7a1-4f3f-b04b-6ca061580aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d25102-643a-473e-b104-1bb6a0bb1d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d25102-643a-473e-b104-1bb6a0bb1d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1013959740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc82bac-b615-4bd7-9776-c67dc5022de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:57Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82faf5f-723b-4cc4-94b3-3a7e16f893d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82faf5f-723b-4cc4-94b3-3a7e16f893d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14abac46-8697-4397-9a49-9ea9b41514c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14abac46-8697-4397-9a49-9ea9b41514c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc82bac-b615-4bd7-9776-c67dc5022de6', 'volume_name': 'volume-3dc82bac-b615-4bd7-9776-c67dc5022de6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e25d89-e400-4852-a190-0dda796960ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e25d89-e400-4852-a190-0dda796960ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fdeec4-57ed-4889-a034-3a6a3f84569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Volume 3dc82bac-b615-4bd7-9776-c67dc5022de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc82bac-b615-4bd7-9776-c67dc5022de6', 'volume_size': 1} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1013959740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc82bac-b615-4bd7-9776-c67dc5022de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:57Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Creating volume 3dc82bac-b615-4bd7-9776-c67dc5022de6 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:57 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Created reservations ['c6505462-03f7-442b-8dfb-46091854dbc5', '2a247a83-fd7c-4e63-86d0-9738155175bd', '2caac407-a60c-48b3-9f26-7db49fd0ae79', 'd3d6c94c-9035-466c-9238-76f79465541e'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:57 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 1073741824 Sep 28 12:34:57 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Delete snapshot completed successfully. Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-de22f0b0-60cc-48a4-be48-dbc433143198 tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-887e0e78-432f-40ba-9db9-fc2ff9e4bf6c-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:57 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 1073741824" returned: 0 in 0.611s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:58 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 Sep 28 12:34:58 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:58 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6" returned: 0 in 0.254s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02fdeec4-57ed-4889-a034-3a6a3f84569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc82bac-b615-4bd7-9776-c67dc5022de6', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dae206-81b1-46b8-b787-bf5959e03585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "cinder-b7071196-032a-4b27-a8ae-407c37465f08-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Volume volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 (3dc82bac-b615-4bd7-9776-c67dc5022de6): created successfully Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dae206-81b1-46b8-b787-bf5959e03585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (d636330f-b7a1-4f3f-b04b-6ca061580aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-b7071196-032a-4b27-a8ae-407c37465f08-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-36057a3f-6f36-4973-a916-392c27cab650 tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "cinder-quobyte-b7071196-032a-4b27-a8ae-407c37465f08" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-quobyte-b7071196-032a-4b27-a8ae-407c37465f08" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8898aaf3-81e8-4c29-a3aa-a7e9b9a03ec1]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:58 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 Sep 28 12:34:58 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:58 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08" returned: 0 in 0.400s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:58 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08 Sep 28 12:34:58 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:59 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-b7071196-032a-4b27-a8ae-407c37465f08" returned: 0 in 0.264s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-quobyte-b7071196-032a-4b27-a8ae-407c37465f08" released by "delete_volume" :: held 0.740s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Created reservations ['095699dd-215a-4456-b689-4d44556f1514', '84c54a5f-07c3-4a75-bd5b-27563c18e61f', '7f543e96-9249-46fb-9363-50ba19932133', '163487e9-2ced-4a27-960d-8e0835344273'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:59 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:34:59 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "cinder-c1e1b507-dfb6-42c4-88c7-233dbcc70a38-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:59 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-c1e1b507-dfb6-42c4-88c7-233dbcc70a38-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.303s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot 86a831b3-0414-4916-baf0-3aec35f435cb of volume 3dc82bac-b615-4bd7-9776-c67dc5022de6 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Deleted volume successfully. Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff2845a-d2eb-454b-962b-aed8ba8d7a31]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-f51ad8e4-166a-4c53-b5a0-390c169a942a tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-b7071196-032a-4b27-a8ae-407c37465f08-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "cinder-quobyte-c1e1b507-dfb6-42c4-88c7-233dbcc70a38" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-quobyte-c1e1b507-dfb6-42c4-88c7-233dbcc70a38" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c063660c-ef69-4e1b-9f23-ab6574829c58]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:59 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 Sep 28 12:34:59 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:59 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 Sep 28 12:34:59 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:00 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6" returned: 0 in 0.438s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:00 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb 1G Sep 28 12:35:00 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:00 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38" returned: 0 in 0.454s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:00 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38 Sep 28 12:35:00 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:00 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-c1e1b507-dfb6-42c4-88c7-233dbcc70a38" returned: 0 in 0.309s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-quobyte-c1e1b507-dfb6-42c4-88c7-233dbcc70a38" released by "delete_volume" :: held 0.814s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Created reservations ['10656663-42c0-452e-8fcd-dead7da0ff89', '8d16af63-30aa-46e5-9b6f-f0859caaa85e', 'bf4a15c8-3f2f-401d-a56e-ad46ccaf6e2a', '9fd28a5f-f215-4dec-99ce-e71f9b12d355'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:00 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb 1G" returned: 0 in 0.493s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:00 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb Sep 28 12:35:00 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:00 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:00 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:00 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb" returned: 0 in 0.383s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb is being set with open permissions: ugo+rw Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:00 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.302s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Deleted volume successfully. Sep 28 12:35:00 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb Sep 28 12:35:00 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:00 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4797328-4370-4595-b8c8-020a9966aa2c tempest-CinderUnicodeTest-1151444630 None] Lock "cinder-c1e1b507-dfb6-42c4-88c7-233dbcc70a38-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:01 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb" returned: 0 in 0.280s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:01 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.info Sep 28 12:35:01 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:01 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.info" returned: 0 in 0.290s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:01 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.info is being set with open permissions: ugo+rw Sep 28 12:35:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:01 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.info Sep 28 12:35:01 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:01 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.info" returned: 0 in 0.330s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:01 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:01 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8a561e05-209e-44df-ab89-cea1df6766b5 tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-86a831b3-0414-4916-baf0-3aec35f435cb-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-86a831b3-0414-4916-baf0-3aec35f435cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-3dc82bac-b615-4bd7-9776-c67dc5022de6" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-3dc82bac-b615-4bd7-9776-c67dc5022de6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-86a831b3-0414-4916-baf0-3aec35f435cb" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-86a831b3-0414-4916-baf0-3aec35f435cb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot 86a831b3-0414-4916-baf0-3aec35f435cb of volume 3dc82bac-b615-4bd7-9776-c67dc5022de6 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e786c22a-e605-43ac-975a-e627213a2566]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:02 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb Sep 28 12:35:02 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:03 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb" returned: 0 in 0.397s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:03 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc82bac-b615-4bd7-9776-c67dc5022de6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:03 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30d1310-d1f7-4f21-83d9-520147d7e3dc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:03 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 Sep 28 12:35:03 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:03 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6" returned: 0 in 0.446s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:03 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb Sep 28 12:35:03 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:04 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb" returned: 0 in 0.488s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:04 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb Sep 28 12:35:04 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:04 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6.86a831b3-0414-4916-baf0-3aec35f435cb" returned: 0 in 0.354s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-86a831b3-0414-4916-baf0-3aec35f435cb" released by "_delete_snapshot" :: held 1.843s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-3dc82bac-b615-4bd7-9776-c67dc5022de6" released by "delete_snapshot" :: held 1.880s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Created reservations ['05a95f1c-62b5-4b82-a8fb-3092cecc3315', '177b15c3-0c02-4d7e-876e-d136117e7ee9', '2ce0b84d-4ab3-45e3-9898-a8f602fd72a9', '09ff4496-532c-475a-b324-b560fba8c5fa'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:04 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a6e08686-248f-4b69-88fa-a90f2d1414b6 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-86a831b3-0414-4916-baf0-3aec35f435cb-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-3dc82bac-b615-4bd7-9776-c67dc5022de6-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-3dc82bac-b615-4bd7-9776-c67dc5022de6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-3dc82bac-b615-4bd7-9776-c67dc5022de6" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-3dc82bac-b615-4bd7-9776-c67dc5022de6" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41f759-4d31-4aad-80ce-9ffbd12508d7]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:05 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 Sep 28 12:35:05 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:05 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6" returned: 0 in 0.410s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:05 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6 Sep 28 12:35:05 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:05 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc82bac-b615-4bd7-9776-c67dc5022de6" returned: 0 in 0.308s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-3dc82bac-b615-4bd7-9776-c67dc5022de6" released by "delete_volume" :: held 0.810s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Created reservations ['fd9f5009-6d98-465d-8494-912415d85d32', '56015dee-af44-4ba0-b2cf-e420b94e1def', 'e5f131ad-f57a-414f-b957-35a40a499ab7', '26869963-9352-476c-8e31-9c5d21eab66c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:06 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:06 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:06 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:06 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-fa1f587e-f2ef-4afd-b2e0-5c2eaaacd823 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-3dc82bac-b615-4bd7-9776-c67dc5022de6-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (4dd3e520-cea6-47d9-8472-87ebc2bc7b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c13d3c7-c4bf-4daa-a93d-f6a766660a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c13d3c7-c4bf-4daa-a93d-f6a766660a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108205015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f1a135-c723-4704-a164-301235156d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:07Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af484dd2-b30c-48e5-8ddf-ed6f05436052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af484dd2-b30c-48e5-8ddf-ed6f05436052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa1606c-fb7c-4baa-8c1a-8e764db3bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa1606c-fb7c-4baa-8c1a-8e764db3bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f1a135-c723-4704-a164-301235156d4f', 'volume_name': 'volume-15f1a135-c723-4704-a164-301235156d4f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f899387-3abe-41b3-b22a-58f9654d0025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f899387-3abe-41b3-b22a-58f9654d0025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33dd84c-dfbd-456f-a386-b9dbfc24d84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:06 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Volume 15f1a135-c723-4704-a164-301235156d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f1a135-c723-4704-a164-301235156d4f', 'volume_size': 1} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108205015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f1a135-c723-4704-a164-301235156d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:07Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Creating volume 15f1a135-c723-4704-a164-301235156d4f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:06 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:06 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:06 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f 1073741824 Sep 28 12:35:06 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:07 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f 1073741824" returned: 0 in 0.582s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:07 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f Sep 28 12:35:07 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:07 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f" returned: 0 in 0.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33dd84c-dfbd-456f-a386-b9dbfc24d84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f1a135-c723-4704-a164-301235156d4f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622b49e5-bd4a-42ff-b254-56331dcf602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:07 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Volume volume-15f1a135-c723-4704-a164-301235156d4f (15f1a135-c723-4704-a164-301235156d4f): created successfully Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622b49e5-bd4a-42ff-b254-56331dcf602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:07 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (4dd3e520-cea6-47d9-8472-87ebc2bc7b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:07 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-51a36807-4215-41ca-afc7-58898efe0e8f tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:35:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot 8c2301a1-9772-45c6-bd62-e819a86dc302 of volume 15f1a135-c723-4704-a164-301235156d4f {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:09 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a2ba6c-d205-4001-8aae-022fbc0ad2de]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:09 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f Sep 28 12:35:09 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:09 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f" returned: 0 in 0.418s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:09 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 1G Sep 28 12:35:09 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:10 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 1G" returned: 0 in 0.579s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f1a135-c723-4704-a164-301235156d4f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:10 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f1a135-c723-4704-a164-301235156d4f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 Sep 28 12:35:10 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (6afa634c-415f-47da-8663-2960808a4daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e040dd03-668a-4b84-b44b-233667483ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e040dd03-668a-4b84-b44b-233667483ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1554305905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29dcbd62-118c-4554-b30d-b96a53d9ce38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:10Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:10 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c057d2-d8ae-438b-9a82-1c6465f97957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c057d2-d8ae-438b-9a82-1c6465f97957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0495b268-d1be-44f1-8354-59f98b3c82d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0495b268-d1be-44f1-8354-59f98b3c82d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29dcbd62-118c-4554-b30d-b96a53d9ce38', 'volume_name': 'volume-29dcbd62-118c-4554-b30d-b96a53d9ce38', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69183133-969e-4c6b-ae73-d0f2758bf45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69183133-969e-4c6b-ae73-d0f2758bf45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffdd451-fc56-4be4-93a0-7818136b7b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:10 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Volume 29dcbd62-118c-4554-b30d-b96a53d9ce38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29dcbd62-118c-4554-b30d-b96a53d9ce38', 'volume_size': 1} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f1a135-c723-4704-a164-301235156d4f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302" returned: 0 in 0.371s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:10 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 is being set with open permissions: ugo+rw Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:10 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 Sep 28 12:35:10 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:10 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:10 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:10 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.info Sep 28 12:35:10 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:11 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.info" returned: 0 in 0.318s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:11 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.info is being set with open permissions: ugo+rw Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:11 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.info Sep 28 12:35:11 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:11 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.info" returned: 0 in 0.274s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1554305905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29dcbd62-118c-4554-b30d-b96a53d9ce38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:10Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Creating volume 29dcbd62-118c-4554-b30d-b96a53d9ce38 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:11 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:11 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 1073741824 Sep 28 12:35:11 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:11 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-fd5c44ea-3a1a-4afb-9000-54225a58ba1b tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:35:11 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 1073741824" returned: 0 in 0.509s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:11 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 Sep 28 12:35:11 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:12 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38" returned: 0 in 0.250s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffdd451-fc56-4be4-93a0-7818136b7b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29dcbd62-118c-4554-b30d-b96a53d9ce38', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be111eb1-59b2-4be8-b51f-d649535330d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-8c2301a1-9772-45c6-bd62-e819a86dc302-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Volume volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 (29dcbd62-118c-4554-b30d-b96a53d9ce38): created successfully Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be111eb1-59b2-4be8-b51f-d649535330d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (6afa634c-415f-47da-8663-2960808a4daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-8c2301a1-9772-45c6-bd62-e819a86dc302-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-15f1a135-c723-4704-a164-301235156d4f" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-2ac1b3a3-4877-4502-811b-095011b7c6f6 tempest-ProjectReaderTests-758428822 None] Created volume successfully. Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-15f1a135-c723-4704-a164-301235156d4f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-8c2301a1-9772-45c6-bd62-e819a86dc302" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-8c2301a1-9772-45c6-bd62-e819a86dc302" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot 8c2301a1-9772-45c6-bd62-e819a86dc302 of volume 15f1a135-c723-4704-a164-301235156d4f {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8c63c1-861e-4274-8065-d6733031b073]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:12 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 Sep 28 12:35:12 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Creating offline snapshot 336badee-f932-46f4-b816-3560c65917a8 of volume 29dcbd62-118c-4554-b30d-b96a53d9ce38 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e5d333-04b9-4b49-9ef5-f801e05aa4d2]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:12 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302" returned: 0 in 0.598s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15f1a135-c723-4704-a164-301235156d4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:13 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 Sep 28 12:35:13 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced42ba9-1138-4cbb-9341-2cdddb9b38ce]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:13 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f Sep 28 12:35:13 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:13 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38" returned: 0 in 0.486s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:13 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 1G Sep 28 12:35:13 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:13 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f" returned: 0 in 0.464s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:13 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 Sep 28 12:35:13 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:13 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Flow 'volume_create_manager' (0875ec43-e0b9-4371-8ba7-b2658a1c5de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4066fd0-cd9c-4e16-8386-b65188f25a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 1G" returned: 0 in 0.639s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4066fd0-cd9c-4e16-8386-b65188f25a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1903351472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4374c56fe2da4b42b2bc768eb5807733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:14Z,use_quota=True,user_id='cc1d923d25b148d089ce6bbff819426f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:14 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af65b58-4ece-4350-9d04-26531d4f865e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:14 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 Sep 28 12:35:14 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af65b58-4ece-4350-9d04-26531d4f865e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50288dcd-587e-4fa5-8711-6593d38e7a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50288dcd-587e-4fa5-8711-6593d38e7a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76', 'volume_name': 'volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfe8a55-5a8f-481f-bae8-d4b922b97302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbfe8a55-5a8f-481f-bae8-d4b922b97302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb68fad-b25f-479b-ab7c-9d5bd3cc1fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:14 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Volume e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76', 'volume_size': 1} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302" returned: 0 in 0.603s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:14 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302 Sep 28 12:35:14 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:14 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:14 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 is being set with open permissions: ugo+rw Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:14 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f.8c2301a1-9772-45c6-bd62-e819a86dc302" returned: 0 in 0.280s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:14 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 Sep 28 12:35:14 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-8c2301a1-9772-45c6-bd62-e819a86dc302" released by "_delete_snapshot" :: held 2.093s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-15f1a135-c723-4704-a164-301235156d4f" released by "delete_snapshot" :: held 2.126s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Created reservations ['ea2ec439-1382-4b47-9755-fee040c7dea8', 'c829003c-089b-49db-8ce0-f8eb39be9d52', '52a90108-5683-40d6-8d0e-3c51f7a88b89', 'e8ea7850-1aff-48d0-a8b4-cdae1bacc0a5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-73a9a980-9c67-4812-8a17-ff34a4a4df08 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-8c2301a1-9772-45c6-bd62-e819a86dc302-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:14 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8" returned: 0 in 0.262s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:14 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.info Sep 28 12:35:14 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:14 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.info" returned: 0 in 0.251s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:14 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.info is being set with open permissions: ugo+rw Sep 28 12:35:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:14 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.info Sep 28 12:35:14 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:15 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.info" returned: 0 in 0.240s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.068s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1903351472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4374c56fe2da4b42b2bc768eb5807733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:14Z,use_quota=True,user_id='cc1d923d25b148d089ce6bbff819426f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Creating volume e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:15 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:15 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 1073741824 Sep 28 12:35:15 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:15 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-06af6eb1-dad7-48b4-9b90-9aada130fe68 tempest-ProjectReaderTests-758428822 None] Create snapshot completed successfully Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-15f1a135-c723-4704-a164-301235156d4f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-15f1a135-c723-4704-a164-301235156d4f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-15f1a135-c723-4704-a164-301235156d4f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-15f1a135-c723-4704-a164-301235156d4f" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9bfc4-37de-409a-9f1c-b3fd77fa33ff]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:15 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 1073741824" returned: 0 in 0.486s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:15 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f Sep 28 12:35:15 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:15 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 Sep 28 12:35:15 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:15 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f" returned: 0 in 0.393s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:15 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" returned: 0 in 0.292s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:15 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f Sep 28 12:35:15 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb68fad-b25f-479b-ab7c-9d5bd3cc1fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b586415-3b88-4a44-aaaf-0b92aef388bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Volume volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 (e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76): created successfully Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b586415-3b88-4a44-aaaf-0b92aef388bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Flow 'volume_create_manager' (0875ec43-e0b9-4371-8ba7-b2658a1c5de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-91b89b67-6ce0-46e2-8b8e-b3e90295d523 tempest-SnapshotDependencyTests-437512646 None] Created volume successfully. Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-336badee-f932-46f4-b816-3560c65917a8-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Lock "cinder-336badee-f932-46f4-b816-3560c65917a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-29dcbd62-118c-4554-b30d-b96a53d9ce38" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-29dcbd62-118c-4554-b30d-b96a53d9ce38" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-336badee-f932-46f4-b816-3560c65917a8" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-336badee-f932-46f4-b816-3560c65917a8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Deleting offline snapshot 336badee-f932-46f4-b816-3560c65917a8 of volume 29dcbd62-118c-4554-b30d-b96a53d9ce38 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] snapshot_file for this snap is: volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba293a2-6fd0-4386-913c-3785b778da1b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:16 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-15f1a135-c723-4704-a164-301235156d4f" returned: 0 in 0.280s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-15f1a135-c723-4704-a164-301235156d4f" released by "delete_volume" :: held 0.743s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Created reservations ['282f2418-98c4-402a-8e20-bf210f8be05b', '8d01868d-eda7-4099-b0e0-112fd42bfb4f', 'aa7da398-e513-4876-9f2a-ccbffb0254f6', '1a1ada5f-9846-4a99-9f01-b3366c0b5c78'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:16 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 Sep 28 12:35:16 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:16 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:16 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:16 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8" returned: 0 in 0.393s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29dcbd62-118c-4554-b30d-b96a53d9ce38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:16 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.265s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e4bf3e-55e9-4681-8772-6e0d4eab1d52]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8431e679-61ca-4e2e-83e3-edb200e0a6c7 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-15f1a135-c723-4704-a164-301235156d4f-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:16 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 Sep 28 12:35:16 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:17 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38" returned: 0 in 0.419s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:17 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 Sep 28 12:35:17 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (fb6b19cd-8ef0-4b11-81f5-906b1ea01385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f27a24-c65f-4046-a53d-efb8f709f939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f27a24-c65f-4046-a53d-efb8f709f939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864309847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ebf0ef-1676-410d-a8ac-7caa3dcd1612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:17Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb16c69-fd8f-4274-bc13-77a17070ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb16c69-fd8f-4274-bc13-77a17070ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba28a9e3-38f4-4a9b-9668-37b7d5db7374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba28a9e3-38f4-4a9b-9668-37b7d5db7374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33ebf0ef-1676-410d-a8ac-7caa3dcd1612', 'volume_name': 'volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdede08-9560-4437-b393-ee55acf5deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdede08-9560-4437-b393-ee55acf5deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d222c93-755b-44b7-879f-91ac5dc6e382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Volume 33ebf0ef-1676-410d-a8ac-7caa3dcd1612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612', 'volume_size': 1} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864309847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ebf0ef-1676-410d-a8ac-7caa3dcd1612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:17Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Creating volume 33ebf0ef-1676-410d-a8ac-7caa3dcd1612 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:17 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:17 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 1073741824 Sep 28 12:35:17 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:17 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8" returned: 0 in 0.352s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:17 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8 Sep 28 12:35:17 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:17 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 1073741824" returned: 0 in 0.439s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:17 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38.336badee-f932-46f4-b816-3560c65917a8" returned: 0 in 0.252s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-336badee-f932-46f4-b816-3560c65917a8" released by "_delete_snapshot" :: held 1.544s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-29dcbd62-118c-4554-b30d-b96a53d9ce38" released by "delete_snapshot" :: held 1.572s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:17 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 Sep 28 12:35:17 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Created reservations ['f8e9e6e1-a077-4b5c-b2f7-229661c2ce14', '766fe0fd-5eb7-4531-a222-2e4a7b8b0c58', '2bd9930f-41db-45a5-9180-49930bccb30a', 'c7985ba6-cba1-4d41-b8c0-bd9420067b58'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Delete snapshot completed successfully. Sep 28 12:35:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-14bafc9c-1c48-4f5b-8bef-e42f42df8ed2 tempest-ProjectReaderTests-758428822 None] Lock "cinder-336badee-f932-46f4-b816-3560c65917a8-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:18 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" returned: 0 in 0.263s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.723s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d222c93-755b-44b7-879f-91ac5dc6e382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08be7d7b-2aa9-44e7-99f0-5355dc9881e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Creating offline snapshot 52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 of volume e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Volume volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 (33ebf0ef-1676-410d-a8ac-7caa3dcd1612): created successfully Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08be7d7b-2aa9-44e7-99f0-5355dc9881e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (fb6b19cd-8ef0-4b11-81f5-906b1ea01385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a70d93-43cd-4b63-a1b3-820671835272]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ef1ea321-802e-4f0c-9ad5-0abb6de1d174 tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:35:18 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 Sep 28 12:35:18 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-29dcbd62-118c-4554-b30d-b96a53d9ce38-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Lock "cinder-29dcbd62-118c-4554-b30d-b96a53d9ce38-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-29dcbd62-118c-4554-b30d-b96a53d9ce38" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-29dcbd62-118c-4554-b30d-b96a53d9ce38" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14f34a3-6793-4ab6-adcc-1a955402c6de]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:18 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" returned: 0 in 0.382s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:18 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 1G Sep 28 12:35:18 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:18 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 Sep 28 12:35:18 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:18 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38" returned: 0 in 0.396s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:18 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38 Sep 28 12:35:18 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:18 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 1G" returned: 0 in 0.461s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:18 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 Sep 28 12:35:18 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:19 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-29dcbd62-118c-4554-b30d-b96a53d9ce38" returned: 0 in 0.297s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-29dcbd62-118c-4554-b30d-b96a53d9ce38" released by "delete_volume" :: held 0.766s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Created reservations ['c91cd613-2fc0-45d0-9248-8f650880915c', '52d6ad2d-2d85-4fd3-953b-2ab36858d9ff', '3b384998-8730-4096-b78a-072ad3e40446', '7de16a1c-1041-4dd4-a2c6-38f7a756b27c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:19 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" returned: 0 in 0.339s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:19 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 is being set with open permissions: ugo+rw Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:19 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 Sep 28 12:35:19 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:19 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:19 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:19 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" returned: 0 in 0.285s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:19 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:19 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.info Sep 28 12:35:19 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.307s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:19 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Deleted volume successfully. Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dccba620-5d09-4993-b20b-f34afd5931c8 tempest-ProjectReaderTests-758428822 None] Lock "cinder-29dcbd62-118c-4554-b30d-b96a53d9ce38-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:19 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.info" returned: 0 in 0.311s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:19 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.info is being set with open permissions: ugo+rw Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:19 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.info Sep 28 12:35:19 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (50accd23-2761-4b23-8a9d-51c788e140eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:19 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de26b7b-6757-4ddd-8e55-4edf8d2cf7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de26b7b-6757-4ddd-8e55-4edf8d2cf7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546672869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8835d3-b463-41a3-958f-629f960d0c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:20Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b707aa8-925f-47f6-ab8e-e85bdd7acf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b707aa8-925f-47f6-ab8e-e85bdd7acf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2887ae03-483b-45a8-94dc-ce921936e7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2887ae03-483b-45a8-94dc-ce921936e7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8835d3-b463-41a3-958f-629f960d0c17', 'volume_name': 'volume-ba8835d3-b463-41a3-958f-629f960d0c17', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a0dbaf-561a-40dc-a475-7953e0927a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a0dbaf-561a-40dc-a475-7953e0927a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca73679-8c28-492d-8b6d-f8154f2aa183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:20 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Volume ba8835d3-b463-41a3-958f-629f960d0c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8835d3-b463-41a3-958f-629f960d0c17', 'volume_size': 1} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:20 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.info" returned: 0 in 0.268s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.152s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.745s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot cd8a851d-3510-4832-a3b4-626a9a6c779d of volume 33ebf0ef-1676-410d-a8ac-7caa3dcd1612 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-f7d454a3-117a-4919-adf3-1867361e16ef tempest-SnapshotDependencyTests-437512646 None] Create snapshot completed successfully Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2b4324-702e-4286-9cc3-60a862d552bd]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:20 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 Sep 28 12:35:20 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:20 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" returned: 0 in 0.384s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:20 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d 1G Sep 28 12:35:20 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:21 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d 1G" returned: 0 in 0.493s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:21 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d Sep 28 12:35:21 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Flow 'volume_create_manager' (9e426204-9f4c-46ec-91aa-88f34bcbe581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45e612f-dfb9-4de0-be7e-be83f76beea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45e612f-dfb9-4de0-be7e-be83f76beea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfada53-a8cf-4383-9920-ebcb3eb94892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4374c56fe2da4b42b2bc768eb5807733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52fd838b-756d-4b2a-88fe-b11b5d7fd4c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:21Z,use_quota=True,user_id='cc1d923d25b148d089ce6bbff819426f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e44e9ce-b0dd-4bce-8752-43e53361bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e44e9ce-b0dd-4bce-8752-43e53361bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b00e45-9d82-4974-8186-c75d4f78a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b00e45-9d82-4974-8186-c75d4f78a556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dcfada53-a8cf-4383-9920-ebcb3eb94892', 'volume_name': 'volume-dcfada53-a8cf-4383-9920-ebcb3eb94892', 'volume_size': 1, 'snapshot_id': '52fd838b-756d-4b2a-88fe-b11b5d7fd4c5'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8730fca0-9009-42d3-bf7d-cfa8079d0024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8730fca0-9009-42d3-bf7d-cfa8079d0024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6946f6b-7864-4763-a152-328796715be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:21 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Volume dcfada53-a8cf-4383-9920-ebcb3eb94892: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dcfada53-a8cf-4383-9920-ebcb3eb94892', 'volume_size': 1, 'snapshot_id': '52fd838b-756d-4b2a-88fe-b11b5d7fd4c5'} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:21 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d" returned: 0 in 0.294s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:21 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d is being set with open permissions: ugo+rw Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:21 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d Sep 28 12:35:21 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:21 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d" returned: 0 in 0.243s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:21 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.info Sep 28 12:35:21 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:21 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.info" returned: 0 in 0.251s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:21 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.info is being set with open permissions: ugo+rw Sep 28 12:35:21 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:21 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.info Sep 28 12:35:21 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:22 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.info" returned: 0 in 0.251s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.138s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546672869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8835d3-b463-41a3-958f-629f960d0c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:20Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Creating volume ba8835d3-b463-41a3-958f-629f960d0c17 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:22 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:22 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 1073741824 Sep 28 12:35:22 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:22 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7072da84-a300-40b3-b2d8-49e5e9deec21 tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-cd8a851d-3510-4832-a3b4-626a9a6c779d-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-cd8a851d-3510-4832-a3b4-626a9a6c779d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-cd8a851d-3510-4832-a3b4-626a9a6c779d" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:22 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-cd8a851d-3510-4832-a3b4-626a9a6c779d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot cd8a851d-3510-4832-a3b4-626a9a6c779d of volume 33ebf0ef-1676-410d-a8ac-7caa3dcd1612 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 1073741824" returned: 0 in 0.484s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6780159-c42b-410d-9bd4-16b672487820]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:22 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 Sep 28 12:35:22 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:22 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d Sep 28 12:35:22 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:22 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17" returned: 0 in 0.252s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.732s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-quobyte-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5-dcfada53-a8cf-4383-9920-ebcb3eb94892" by "_create_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:22 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca73679-8c28-492d-8b6d-f8154f2aa183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8835d3-b463-41a3-958f-629f960d0c17', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef0a4b6-8b9d-4c45-a4ed-86f787ae5898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5-dcfada53-a8cf-4383-9920-ebcb3eb94892" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Creating volume dcfada53-a8cf-4383-9920-ebcb3eb94892 from snapshot 52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 {{(pid=87167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-quobyte-dcfada53-a8cf-4383-9920-ebcb3eb94892" by "_copy_volume_from_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:23 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Volume volume-ba8835d3-b463-41a3-958f-629f960d0c17 (ba8835d3-b463-41a3-958f-629f960d0c17): created successfully Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef0a4b6-8b9d-4c45-a4ed-86f787ae5898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (50accd23-2761-4b23-8a9d-51c788e140eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-dcfada53-a8cf-4383-9920-ebcb3eb94892" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] snapshot: 52fd838b-756d-4b2a-88fe-b11b5d7fd4c5, volume: dcfada53-a8cf-4383-9920-ebcb3eb94892, {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:35:23 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:23 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-04a65257-5216-427e-9ef1-ada3bef3404b tempest-ProjectReaderTests-758428822 None] Created volume successfully. Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d" returned: 0 in 0.436s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d7838-7d5a-4f86-a165-a4e65e988621]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[26086e2b-6213-4fc2-9a44-74c30cfc7b1c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 Sep 28 12:35:23 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:23 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 Sep 28 12:35:23 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:23 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:23 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" returned: 0 in 0.352s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" returned: 0 in 0.377s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:23 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d Sep 28 12:35:23 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da98649-fd56-4af7-84cf-22d4b34c6cec]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 Sep 28 12:35:23 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:23 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d" returned: 0 in 0.341s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d Sep 28 12:35:23 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:23 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" returned: 0 in 0.388s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Creating direct copy from snapshot {{(pid=87167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG cinder.utils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Path /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 not found in is_blk_device check {{(pid=87167) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:35:23 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 Sep 28 12:35:23 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:24 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612.cd8a851d-3510-4832-a3b4-626a9a6c779d" returned: 0 in 0.285s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-cd8a851d-3510-4832-a3b4-626a9a6c779d" released by "_delete_snapshot" :: held 1.531s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" released by "delete_snapshot" :: held 1.555s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Created reservations ['6a9ae695-a58a-45ad-b79c-86c51ee82f84', '07ed173e-c9a6-4914-87e1-f36d5cf57aca', 'b32bd922-7578-4616-8c64-7eb318e8e13a', '4f3563e2-005e-4c0b-9fcf-6ca4d99d8054'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:24 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-53bde3e5-205e-4fc9-8ab0-522427613e4d tempest-ProjectMemberTests-1684550222 None] Lock "cinder-cd8a851d-3510-4832-a3b4-626a9a6c779d-delete_snapshot" released by "delete_snapshot" :: held 1.739s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-33ebf0ef-1676-410d-a8ac-7caa3dcd1612-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-33ebf0ef-1676-410d-a8ac-7caa3dcd1612-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:24 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" acquired by "delete_volume" :: waited 0.031s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:25 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84c4cc-944a-4ce2-8a33-ddb91f28acbc]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:25 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 Sep 28 12:35:25 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:25 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" returned: 0 in 0.533s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:25 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:25 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612 Sep 28 12:35:25 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:25 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-33ebf0ef-1676-410d-a8ac-7caa3dcd1612" released by "delete_volume" :: held 1.042s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Created reservations ['7ee66eb2-5aa7-4593-9d30-35db510a9202', 'ca1d819b-dd40-4d9e-9cee-f481bc97f912', '6301bbbb-bf65-48ee-857d-06eb7e5e8855', 'a6779046-26bb-48d3-80c7-16264ac3835a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:26 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:26 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:26 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.359s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:26 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:35:26 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a8eed859-f285-4dbc-9de6-fea15c29d3c1 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-33ebf0ef-1676-410d-a8ac-7caa3dcd1612-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:27 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (28fb0a44-6602-4812-8bf3-2e4f41b4f34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b289ac5d-4e82-4db9-a806-d2c35bbd9501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b289ac5d-4e82-4db9-a806-d2c35bbd9501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086084111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a822e90a-ccde-4a6a-bd16-ca0c13dce1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:28Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d509865-643b-4cca-b5e3-18881e2c339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:27 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d509865-643b-4cca-b5e3-18881e2c339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b132cd0b-b3d5-4251-a1d8-fbf2de9c42cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b132cd0b-b3d5-4251-a1d8-fbf2de9c42cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a822e90a-ccde-4a6a-bd16-ca0c13dce1b1', 'volume_name': 'volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a21286-98f1-41f6-b798-df4a2d86f97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a21286-98f1-41f6-b798-df4a2d86f97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:28 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93588c94-03b8-40f4-afbe-a607d24020e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:28 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Volume a822e90a-ccde-4a6a-bd16-ca0c13dce1b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1', 'volume_size': 1} Sep 28 12:35:28 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:30 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892" returned: 0 in 6.990s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:30 devstack cinder-volume[87167]: DEBUG cinder.image.image_utils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Image conversion details: src /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 {{(pid=87167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:35:30 devstack cinder-volume[87167]: INFO cinder.image.image_utils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Converted 1024.00 MB image at 146.49 MB/s Sep 28 12:35:30 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 is being set with open permissions: ugo+rw Sep 28 12:35:30 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:30 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 Sep 28 12:35:30 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:31 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892" returned: 0 in 0.236s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-dcfada53-a8cf-4383-9920-ebcb3eb94892" released by "_copy_volume_from_snapshot" :: held 8.109s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5-dcfada53-a8cf-4383-9920-ebcb3eb94892" released by "_create_volume_from_snapshot" :: held 8.203s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.247s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.831s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Creating offline snapshot 139736c0-b738-4e83-bba2-a583ea9125d8 of volume ba8835d3-b463-41a3-958f-629f960d0c17 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6946f6b-7864-4763-a152-328796715be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcfada53-a8cf-4383-9920-ebcb3eb94892', 'volume_size': 1, 'snapshot_id': '52fd838b-756d-4b2a-88fe-b11b5d7fd4c5'}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50161dc4-bff4-491e-a9eb-12569a56f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bbff93-485d-4539-b588-c3bc660a3f28]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:31 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Volume volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 (dcfada53-a8cf-4383-9920-ebcb3eb94892): created successfully Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50161dc4-bff4-491e-a9eb-12569a56f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Flow 'volume_create_manager' (9e426204-9f4c-46ec-91aa-88f34bcbe581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:31 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-a1e27790-5105-4f2e-b91a-31a88f148cce tempest-SnapshotDependencyTests-437512646 None] Created volume successfully. Sep 28 12:35:31 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 Sep 28 12:35:31 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:31 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17" returned: 0 in 0.369s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:31 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:31 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 1G Sep 28 12:35:31 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-quobyte-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-quobyte-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Deleting offline snapshot 52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 of volume e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] snapshot_file for this snap is: volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:32 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 1G" returned: 0 in 0.468s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8835d3-b463-41a3-958f-629f960d0c17 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be8df8a-2ac6-4aeb-9472-a7d231171a1d]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8835d3-b463-41a3-958f-629f960d0c17 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 Sep 28 12:35:32 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:32 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 Sep 28 12:35:32 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:32 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8835d3-b463-41a3-958f-629f960d0c17 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:32 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 is being set with open permissions: ugo+rw Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 Sep 28 12:35:32 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:32 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" returned: 0 in 0.375s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c936d164-75d9-4a36-be61-540a0db99e44]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 Sep 28 12:35:32 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:32 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8" returned: 0 in 0.259s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.info Sep 28 12:35:32 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:32 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.info" returned: 0 in 0.268s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:32 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.info is being set with open permissions: ugo+rw Sep 28 12:35:32 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.info Sep 28 12:35:32 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:33 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" returned: 0 in 0.565s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:33 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 Sep 28 12:35:33 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:33 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.info" returned: 0 in 0.272s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.207s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1086084111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a822e90a-ccde-4a6a-bd16-ca0c13dce1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467a82e954f4263bd8186cd34823909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:28Z,use_quota=True,user_id='f3d199afc938421a95fb72d2e79f41bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Creating volume a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:33 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:33 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 1073741824 Sep 28 12:35:33 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-be5106fa-c48a-4a2f-8530-51a7c74589a8 tempest-ProjectReaderTests-758428822 None] Create snapshot completed successfully Sep 28 12:35:33 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" returned: 0 in 0.357s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:33 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5 Sep 28 12:35:33 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:33 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 1073741824" returned: 0 in 0.429s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:33 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76.52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" returned: 0 in 0.284s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:33 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 Sep 28 12:35:33 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5" released by "_delete_snapshot" :: held 1.704s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" released by "delete_snapshot" :: held 1.731s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Created reservations ['d697b385-c00c-4e67-9272-91aa762e2897', '883ffd15-b6ad-4467-b5a7-983a4e2a002b', '125dccaa-daf1-4a71-aa4d-22b44018781c', '0838ab9b-10cd-4ec2-ba4b-87bc3279a0b5'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-139736c0-b738-4e83-bba2-a583ea9125d8-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:33 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Delete snapshot completed successfully. Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-81d33149-c614-4c46-be76-d0d6d10330b8 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-52fd838b-756d-4b2a-88fe-b11b5d7fd4c5-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Lock "cinder-139736c0-b738-4e83-bba2-a583ea9125d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-ba8835d3-b463-41a3-958f-629f960d0c17" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-ba8835d3-b463-41a3-958f-629f960d0c17" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-139736c0-b738-4e83-bba2-a583ea9125d8" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:33 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-139736c0-b738-4e83-bba2-a583ea9125d8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Deleting offline snapshot 139736c0-b738-4e83-bba2-a583ea9125d8 of volume ba8835d3-b463-41a3-958f-629f960d0c17 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:34 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] snapshot_file for this snap is: volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" returned: 0 in 0.314s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93588c94-03b8-40f4-afbe-a607d24020e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f7e0d1-6e24-4226-8f78-40ce0743106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a33de34-5aff-4fcd-9fc0-c07049a882eb]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:34 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Volume volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 (a822e90a-ccde-4a6a-bd16-ca0c13dce1b1): created successfully Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f7e0d1-6e24-4226-8f78-40ce0743106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Flow 'volume_create_manager' (28fb0a44-6602-4812-8bf3-2e4f41b4f34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:34 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-195eb659-a8bb-4ee8-bbd1-ca0334e23143 tempest-ProjectMemberTests-1684550222 None] Created volume successfully. Sep 28 12:35:34 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 Sep 28 12:35:34 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-quobyte-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bccb3c4-8ca3-4255-a967-ea216cab1120]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Creating offline snapshot e7c23ff6-6d5c-4271-8901-de29d205a424 of volume a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6769f9af-f53a-4bf3-9736-ec884750dd3b]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:34 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 Sep 28 12:35:34 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:34 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8" returned: 0 in 0.470s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba8835d3-b463-41a3-958f-629f960d0c17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c025bb27-37f9-406d-94d6-5f966d527319]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:34 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 Sep 28 12:35:34 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:34 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 Sep 28 12:35:34 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:34 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" returned: 0 in 0.412s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:34 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76 Sep 28 12:35:34 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:34 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" returned: 0 in 0.441s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:34 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 1G Sep 28 12:35:34 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:34 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17" returned: 0 in 0.427s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:34 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 Sep 28 12:35:35 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" returned: 0 in 0.301s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76" released by "delete_volume" :: held 0.808s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Created reservations ['c78802ee-03d2-468a-a6ef-d0ba244fe02a', 'a820bd32-5556-4c39-92a7-da89f6f932bd', '07c08ce7-cf5b-499d-8978-e059e4f5f2d5', 'eca8a694-afaa-48cb-8bf5-c03d0404b252'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:35 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-dcfada53-a8cf-4383-9920-ebcb3eb94892-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:35 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8" returned: 0 in 0.414s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 1G" returned: 0 in 0.540s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8 Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-dcfada53-a8cf-4383-9920-ebcb3eb94892-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:35 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 Sep 28 12:35:35 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "cinder-quobyte-dcfada53-a8cf-4383-9920-ebcb3eb94892" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-dcfada53-a8cf-4383-9920-ebcb3eb94892" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:35 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Deleted volume successfully. Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f4b42c-10f2-43ef-bccb-ec1541febbbd]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-36de5f81-36bd-447c-b924-56818cd14802 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-e5f8fd8c-cc99-4b45-8b3f-1cf0c3c9bd76-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:35 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 Sep 28 12:35:35 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17.139736c0-b738-4e83-bba2-a583ea9125d8" returned: 0 in 0.344s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-139736c0-b738-4e83-bba2-a583ea9125d8" released by "_delete_snapshot" :: held 1.785s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-ba8835d3-b463-41a3-958f-629f960d0c17" released by "delete_snapshot" :: held 1.812s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:35 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424" returned: 0 in 0.365s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 is being set with open permissions: ugo+rw Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 Sep 28 12:35:35 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Created reservations ['8c54b77f-6248-4d67-adcf-e7d13d9aae33', '0fc1a64c-e587-4960-a964-2af27e236d00', '2adaaa4d-a9ec-4dc3-9ede-04a9e452d872', 'c06435f8-1841-4a97-9cb1-ec523cb6abcc'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:35 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Delete snapshot completed successfully. Sep 28 12:35:35 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-92ccead4-babf-49e2-9d8b-ad51c1ba063c tempest-ProjectReaderTests-758428822 None] Lock "cinder-139736c0-b738-4e83-bba2-a583ea9125d8-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:35 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892" returned: 0 in 0.418s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:36 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892 Sep 28 12:35:36 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424" returned: 0 in 0.299s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-ba8835d3-b463-41a3-958f-629f960d0c17-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:36 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.info Sep 28 12:35:36 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Lock "cinder-ba8835d3-b463-41a3-958f-629f960d0c17-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-ba8835d3-b463-41a3-958f-629f960d0c17" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-ba8835d3-b463-41a3-958f-629f960d0c17" acquired by "delete_volume" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e90bcbd-05da-42cd-a5ab-40b33579299e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:36 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-dcfada53-a8cf-4383-9920-ebcb3eb94892" returned: 0 in 0.297s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-quobyte-dcfada53-a8cf-4383-9920-ebcb3eb94892" released by "delete_volume" :: held 0.785s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Created reservations ['57fa5c97-57c8-47d0-8ca5-21d62171e0ed', '3a24024f-c1e6-41da-8a83-f645780a5e8f', '7b525437-33dc-4964-8b44-009239861366', 'eb7d5c24-b440-4b85-b634-5f681c79289a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:36 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 Sep 28 12:35:36 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:36 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.info" returned: 0 in 0.316s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.info is being set with open permissions: ugo+rw Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:36 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:36 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.info Sep 28 12:35:36 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17" returned: 0 in 0.421s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:36 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17 Sep 28 12:35:36 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.310s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:36 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.info" returned: 0 in 0.308s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Deleted volume successfully. Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-7790e850-c838-4bc4-843e-3ebe33257212 tempest-SnapshotDependencyTests-437512646 None] Lock "cinder-dcfada53-a8cf-4383-9920-ebcb3eb94892-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:36 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-776e4aac-efeb-4726-8002-3a13306f22fd tempest-ProjectMemberTests-1684550222 None] Create snapshot completed successfully Sep 28 12:35:36 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ba8835d3-b463-41a3-958f-629f960d0c17" returned: 0 in 0.273s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-ba8835d3-b463-41a3-958f-629f960d0c17" released by "delete_volume" :: held 0.760s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Created reservations ['1229e735-b054-4431-84d8-f370692026f9', '4f35a786-64ad-4cef-b66f-6322f1e22f8f', 'c0068208-9437-42c4-b427-434260050d03', '36ebe501-a555-434a-bd3e-f96e699080f2'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:37 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:37 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:37 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.263s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:37 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Deleted volume successfully. Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-6eceee96-1001-4863-ad55-eb0c9654e95b tempest-ProjectReaderTests-758428822 None] Lock "cinder-ba8835d3-b463-41a3-958f-629f960d0c17-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-e7c23ff6-6d5c-4271-8901-de29d205a424-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-e7c23ff6-6d5c-4271-8901-de29d205a424-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-e7c23ff6-6d5c-4271-8901-de29d205a424" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-e7c23ff6-6d5c-4271-8901-de29d205a424" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Deleting offline snapshot e7c23ff6-6d5c-4271-8901-de29d205a424 of volume a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] snapshot_file for this snap is: volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba5d646-c5d4-406b-a665-2db85b98c498]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (585381ad-6d93-4c5e-a177-0ca21a128227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7109edf8-8c4b-4d42-9949-6441724401af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7109edf8-8c4b-4d42-9949-6441724401af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717699589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2b14cc-901d-48a6-b12b-893fbff4bf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:38Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d01b6e-ffb1-474c-87bc-b53a4ca57cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d01b6e-ffb1-474c-87bc-b53a4ca57cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:37 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6266a20f-3af3-480f-8280-36b4ba712c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6266a20f-3af3-480f-8280-36b4ba712c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2b14cc-901d-48a6-b12b-893fbff4bf1f', 'volume_name': 'volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8babbd-f6a5-49e1-9a02-aa8737f4f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8babbd-f6a5-49e1-9a02-aa8737f4f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:38 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 Sep 28 12:35:38 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa026247-f7a8-4c2a-8e3e-2a34cadfcaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Volume fb2b14cc-901d-48a6-b12b-893fbff4bf1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f', 'volume_size': 1} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1717699589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2b14cc-901d-48a6-b12b-893fbff4bf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:38Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Creating volume fb2b14cc-901d-48a6-b12b-893fbff4bf1f {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:38 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:38 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f 1073741824 Sep 28 12:35:38 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:38 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424" returned: 0 in 0.434s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7baf3f-ec20-42d4-b30c-d8d7276af76c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:38 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 Sep 28 12:35:38 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:38 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f 1073741824" returned: 0 in 0.482s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:38 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f Sep 28 12:35:38 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:38 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" returned: 0 in 0.381s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:38 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 Sep 28 12:35:38 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:38 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" returned: 0 in 0.288s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa026247-f7a8-4c2a-8e3e-2a34cadfcaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113e9c81-905a-4397-8fd6-c937841df992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:38 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Volume volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f (fb2b14cc-901d-48a6-b12b-893fbff4bf1f): created successfully Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113e9c81-905a-4397-8fd6-c937841df992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:38 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (585381ad-6d93-4c5e-a177-0ca21a128227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:38 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ac857e11-381f-4532-bdc2-07675e2f5fce tempest-ProjectReaderTests-758428822 None] Created volume successfully. Sep 28 12:35:39 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424" returned: 0 in 0.390s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:39 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424 Sep 28 12:35:39 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:39 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1.e7c23ff6-6d5c-4271-8901-de29d205a424" returned: 0 in 0.275s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-e7c23ff6-6d5c-4271-8901-de29d205a424" released by "_delete_snapshot" :: held 1.607s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" released by "delete_snapshot" :: held 1.631s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Created reservations ['38b686f6-5486-4043-bca7-2fa682071146', 'bb54c3a5-4399-47ad-932b-6be18739055a', 'c24f6c38-5796-4570-b9a2-a220ee604f23', '06b792c4-3b0b-405b-a841-edd359f30848'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:39 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Delete snapshot completed successfully. Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-27c7c2d8-ad55-40b6-9ff7-4441f7c5aa96 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-e7c23ff6-6d5c-4271-8901-de29d205a424-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:39 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "cinder-quobyte-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c00a67-ac7e-4610-a9c0-c7390406c246]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Creating offline snapshot 23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd of volume fb2b14cc-901d-48a6-b12b-893fbff4bf1f {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41e19d-5725-4683-b1d1-45df7fe6f8ad]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:40 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 Sep 28 12:35:40 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:40 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f Sep 28 12:35:40 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:40 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" returned: 0 in 0.449s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:40 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1 Sep 28 12:35:40 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:40 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" returned: 0 in 0.477s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:40 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd 1G Sep 28 12:35:40 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:40 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" returned: 0 in 0.291s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-quobyte-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1" released by "delete_volume" :: held 0.816s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:40 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Created reservations ['fe8d488e-1429-485d-9945-20ad5e341b30', '3ea57593-1505-4cc2-9cec-6fdc6cd06589', 'de5bf514-41e2-4969-963e-828e27abfb3c', '3b2f481e-9230-4a8c-848c-e91e1ee597bd'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:41 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:41 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:41 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd 1G" returned: 0 in 0.572s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:41 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd Sep 28 12:35:41 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:41 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.378s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:41 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Deleted volume successfully. Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-8a96738c-c768-48c7-8abd-be70d864a993 tempest-ProjectMemberTests-1684550222 None] Lock "cinder-a822e90a-ccde-4a6a-bd16-ca0c13dce1b1-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:41 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd" returned: 0 in 0.404s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:41 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd is being set with open permissions: ugo+rw Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:41 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd Sep 28 12:35:41 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd" returned: 0 in 0.286s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:41 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:41 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:41 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.info Sep 28 12:35:41 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:42 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.info" returned: 0 in 0.292s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:42 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.info is being set with open permissions: ugo+rw Sep 28 12:35:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:42 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.info Sep 28 12:35:42 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:42 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.info" returned: 0 in 0.306s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:42 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:42 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-73a6178f-1df3-4994-a896-da28bb1fbe7e tempest-ProjectReaderTests-758428822 None] Create snapshot completed successfully Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Lock "cinder-23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Deleting offline snapshot 23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd of volume fb2b14cc-901d-48a6-b12b-893fbff4bf1f {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] snapshot_file for this snap is: volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad19a14c-ea63-4297-a399-f24998edd153]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:43 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd Sep 28 12:35:43 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:43 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd" returned: 0 in 0.470s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a7feb-6e43-413b-8c52-503d11cdc3fd]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:43 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:44 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f Sep 28 12:35:44 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:44 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" returned: 0 in 0.435s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:44 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd Sep 28 12:35:44 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:44 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:44 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:44 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd Sep 28 12:35:44 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:45 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f.23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd" returned: 0 in 0.311s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd" released by "_delete_snapshot" :: held 1.773s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" released by "delete_snapshot" :: held 1.804s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Created reservations ['7e43e11f-07bb-416d-8258-6d58840acfc6', 'c2b557b4-6fc1-472a-8f81-80396423ed77', '979b73a8-05b1-484d-918e-31fc3d291fc9', '628923cd-ec69-40a3-abca-c970d426fa97'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:45 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Delete snapshot completed successfully. Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-507981b2-4b72-4021-b673-96c8f61dc969 tempest-ProjectReaderTests-758428822 None] Lock "cinder-23e88a8a-2a5d-4e11-ae7c-ef8a88b1f1cd-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-fb2b14cc-901d-48a6-b12b-893fbff4bf1f-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Lock "cinder-fb2b14cc-901d-48a6-b12b-893fbff4bf1f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" acquired by "delete_volume" :: waited 0.013s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[13816cff-8526-42ad-ac74-e05d213bc897]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:45 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:45 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f Sep 28 12:35:45 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:46 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" returned: 0 in 0.436s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:46 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f Sep 28 12:35:46 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:46 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" returned: 0 in 0.252s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-fb2b14cc-901d-48a6-b12b-893fbff4bf1f" released by "delete_volume" :: held 0.751s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:UPDATE=172,cinder:SELECT=163,cinder:INSERT=54,cinder:DELETE=15 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=146,cinder:INSERT=52,cinder:UPDATE=215,cinder:DELETE=18 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Created reservations ['990d49f9-f92b-473d-8cc8-dd88eac0bce6', '9b675488-4f5f-4581-b2fb-3dd00eccff9a', '60b97b5a-8ea3-4143-b9fc-0b3a5886d185', 'be2c6584-9000-4490-8512-0141dae2dfe1'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:46 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:46 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:46 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:46 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Deleted volume successfully. Sep 28 12:35:46 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-9dc73683-19ba-4880-8382-b20acc6d0124 tempest-ProjectReaderTests-758428822 None] Lock "cinder-fb2b14cc-901d-48a6-b12b-893fbff4bf1f-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (d388eb57-dcc7-4660-bd62-ee3e89a0e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51c61c2-7855-4f89-b8b5-4ffac41a5fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51c61c2-7855-4f89-b8b5-4ffac41a5fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838111681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826b892e-3121-468c-a2e3-63ab476cc748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:47Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97daf0ef-e78b-4004-a9e0-fa66f7e12ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97daf0ef-e78b-4004-a9e0-fa66f7e12ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0a4f5d-2bc2-4121-b98f-13d16c9c1c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0a4f5d-2bc2-4121-b98f-13d16c9c1c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826b892e-3121-468c-a2e3-63ab476cc748', 'volume_name': 'volume-826b892e-3121-468c-a2e3-63ab476cc748', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37c1ef9-98ce-422e-834b-0bb4f025600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37c1ef9-98ce-422e-834b-0bb4f025600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fdd723-69f1-4e4f-b57e-0fe9a880c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:47 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Volume 826b892e-3121-468c-a2e3-63ab476cc748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826b892e-3121-468c-a2e3-63ab476cc748', 'volume_size': 1} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838111681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826b892e-3121-468c-a2e3-63ab476cc748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:47Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Creating volume 826b892e-3121-468c-a2e3-63ab476cc748 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:47 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:47 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:47 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 1073741824 Sep 28 12:35:47 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:48 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 1073741824" returned: 0 in 0.519s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:48 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 Sep 28 12:35:48 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:48 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748" returned: 0 in 0.248s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fdd723-69f1-4e4f-b57e-0fe9a880c580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826b892e-3121-468c-a2e3-63ab476cc748', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cae9cf-001f-4458-82e3-824e2ff58bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:48 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Volume volume-826b892e-3121-468c-a2e3-63ab476cc748 (826b892e-3121-468c-a2e3-63ab476cc748): created successfully Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cae9cf-001f-4458-82e3-824e2ff58bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:48 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (d388eb57-dcc7-4660-bd62-ee3e89a0e67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:48 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-691223d5-7031-450a-be10-aaa51c198612 tempest-ProjectReaderTests-758428822 None] Created volume successfully. Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:49 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:49 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Creating offline snapshot a9a58e65-e1c4-44f2-8933-79774d749495 of volume 826b892e-3121-468c-a2e3-63ab476cc748 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb5f1e0-8c8a-4591-b659-47b554fcf82e]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:49 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.261s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:35:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:35:49 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 Sep 28 12:35:49 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:50 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748" returned: 0 in 0.383s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:50 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 1G Sep 28 12:35:50 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:50 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 1G" returned: 0 in 0.384s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826b892e-3121-468c-a2e3-63ab476cc748 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:50 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826b892e-3121-468c-a2e3-63ab476cc748 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 Sep 28 12:35:50 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:50 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-826b892e-3121-468c-a2e3-63ab476cc748 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:50 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 is being set with open permissions: ugo+rw Sep 28 12:35:50 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:50 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 Sep 28 12:35:50 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:51 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495" returned: 0 in 0.265s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:51 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.info Sep 28 12:35:51 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:51 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.info" returned: 0 in 0.251s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:51 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.info is being set with open permissions: ugo+rw Sep 28 12:35:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:51 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.info Sep 28 12:35:51 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:51 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.info" returned: 0 in 0.267s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:51 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:51 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c5080c28-7fb1-4b79-958e-24cd78bec2e2 tempest-ProjectReaderTests-758428822 None] Create snapshot completed successfully Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-a9a58e65-e1c4-44f2-8933-79774d749495-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Lock "cinder-a9a58e65-e1c4-44f2-8933-79774d749495-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-826b892e-3121-468c-a2e3-63ab476cc748" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-826b892e-3121-468c-a2e3-63ab476cc748" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-a9a58e65-e1c4-44f2-8933-79774d749495" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-a9a58e65-e1c4-44f2-8933-79774d749495" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Deleting offline snapshot a9a58e65-e1c4-44f2-8933-79774d749495 of volume 826b892e-3121-468c-a2e3-63ab476cc748 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] snapshot_file for this snap is: volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ddb94b-2ce9-436e-b4aa-ba4d066f5d55]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:52 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:53 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 Sep 28 12:35:53 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:53 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495" returned: 0 in 0.407s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:53 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-826b892e-3121-468c-a2e3-63ab476cc748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:53 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8064b0-9f27-4ced-bc11-a33b369ea3c4]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:53 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 Sep 28 12:35:53 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:53 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748" returned: 0 in 0.379s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:53 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:53 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 Sep 28 12:35:53 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:54 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495" returned: 0 in 0.370s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:54 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495 Sep 28 12:35:54 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:54 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748.a9a58e65-e1c4-44f2-8933-79774d749495" returned: 0 in 0.261s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-a9a58e65-e1c4-44f2-8933-79774d749495" released by "_delete_snapshot" :: held 1.538s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-826b892e-3121-468c-a2e3-63ab476cc748" released by "delete_snapshot" :: held 1.560s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Created reservations ['8bca68b0-9f7b-4808-a098-99349b735a94', '8ef9b73c-458a-40b1-83fa-ba1eeb30049a', '7102a252-8f55-43c2-bd11-f0367c65fa37', '211b056c-5cb1-4637-8212-a69e921cc732'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:54 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Delete snapshot completed successfully. Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-52cad772-dbef-4d79-8128-bcfdf3c9e941 tempest-ProjectReaderTests-758428822 None] Lock "cinder-a9a58e65-e1c4-44f2-8933-79774d749495-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Flow 'volume_create_manager' (e94108bb-f416-4a4f-a681-544f3a159cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78d3804-c378-4654-bedb-48b836dcf914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78d3804-c378-4654-bedb-48b836dcf914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132608049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f85dd9-606d-4a84-9ccc-3b95d83ed7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd2f792c092450c93393c1b8144eaa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:55Z,use_quota=True,user_id='024b876b64e0404981c43400bbd63448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c199c2b0-755c-4a9c-8a9c-354db869884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c199c2b0-755c-4a9c-8a9c-354db869884f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27eb9ca-586a-40a0-a20e-448b0f4d5f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27eb9ca-586a-40a0-a20e-448b0f4d5f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f85dd9-606d-4a84-9ccc-3b95d83ed7dc', 'volume_name': 'volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576f0995-7fa0-4dc7-973f-b27b53a8e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576f0995-7fa0-4dc7-973f-b27b53a8e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbe11da-066c-4b00-939c-2b31e6513fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:54 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Volume 92f85dd9-606d-4a84-9ccc-3b95d83ed7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc', 'volume_size': 1} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132608049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f85dd9-606d-4a84-9ccc-3b95d83ed7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd2f792c092450c93393c1b8144eaa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:55Z,use_quota=True,user_id='024b876b64e0404981c43400bbd63448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Creating volume 92f85dd9-606d-4a84-9ccc-3b95d83ed7dc {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:54 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:54 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc 1073741824 Sep 28 12:35:54 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-826b892e-3121-468c-a2e3-63ab476cc748-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:54 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Lock "cinder-826b892e-3121-468c-a2e3-63ab476cc748-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-826b892e-3121-468c-a2e3-63ab476cc748" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-826b892e-3121-468c-a2e3-63ab476cc748" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6bb4e-a3f0-41a4-af3b-27192e5a9141]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:55 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 Sep 28 12:35:55 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:55 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc 1073741824" returned: 0 in 0.441s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:55 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc Sep 28 12:35:55 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:55 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748" returned: 0 in 0.401s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:55 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748 Sep 28 12:35:55 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:55 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc" returned: 0 in 0.251s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bbe11da-066c-4b00-939c-2b31e6513fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3eabc8-91a3-4f7c-81e3-1b405994c59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:55 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Volume volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc (92f85dd9-606d-4a84-9ccc-3b95d83ed7dc): created successfully Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3eabc8-91a3-4f7c-81e3-1b405994c59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Flow 'volume_create_manager' (e94108bb-f416-4a4f-a681-544f3a159cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:55 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-40b8709b-d00a-4baf-9f8e-def38bdec9b5 tempest-ProjectReaderTests-768350916 None] Created volume successfully. Sep 28 12:35:55 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-826b892e-3121-468c-a2e3-63ab476cc748" returned: 0 in 0.265s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-826b892e-3121-468c-a2e3-63ab476cc748" released by "delete_volume" :: held 0.730s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Created reservations ['bc5c6e00-a554-4224-81f8-0c7d209636d8', 'a33554be-192e-4caa-acb8-916ab13f4620', '394d83d9-be42-4abe-8df4-5b6213fcc4f4', 'a20eabc6-2eee-455f-a2c3-1cde838e3203'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:55 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:55 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:55 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Acquiring lock "cinder-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Lock "cinder-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Acquiring lock "cinder-quobyte-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Lock "cinder-quobyte-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d98aa2-9fdc-428e-9d5a-800ee90a368c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:56 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.281s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:56 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Deleted volume successfully. Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0b706a81-be89-484a-a815-2b6bfa40a754 tempest-ProjectReaderTests-758428822 None] Lock "cinder-826b892e-3121-468c-a2e3-63ab476cc748-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:56 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc Sep 28 12:35:56 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:56 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc" returned: 0 in 0.415s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:56 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc Sep 28 12:35:56 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (3bb60a99-49bf-4fae-a817-97148ffa9da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be740c0-e78f-4d3c-81e5-d68b576e05ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be740c0-e78f-4d3c-81e5-d68b576e05ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630993761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8daeb320-69ff-4f64-8f5a-5a9b01b31bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:57Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e27129-1430-435c-b9e4-1e89fc5cfaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e27129-1430-435c-b9e4-1e89fc5cfaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed6441d-eaae-4705-88a0-caa0dc4cd0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed6441d-eaae-4705-88a0-caa0dc4cd0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8daeb320-69ff-4f64-8f5a-5a9b01b31bb2', 'volume_name': 'volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29c49fc-b6da-424d-b478-4e6b5a4fb52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29c49fc-b6da-424d-b478-4e6b5a4fb52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0680557d-fa23-443f-8c57-3691973fc912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:56 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Volume 8daeb320-69ff-4f64-8f5a-5a9b01b31bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2', 'volume_size': 1} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630993761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8daeb320-69ff-4f64-8f5a-5a9b01b31bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef3038a87a24a569ef608cc21f24a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:57Z,use_quota=True,user_id='0302532a4573476a9c2f1d8090c0837e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Creating volume 8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:56 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:56 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 1073741824 Sep 28 12:35:56 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:56 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc" returned: 0 in 0.269s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Lock "cinder-quobyte-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc" released by "delete_volume" :: held 0.745s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Created reservations ['0eb2a39b-2f94-4eb6-904d-f5803f9cc5c5', 'ad1a54f1-854a-434f-b745-92818f3fd439', '7bd135f8-9fd0-498f-893c-ec69624d1d48', '4dd8f99e-579f-4648-8296-90afe53609a4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:56 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:56 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:56 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:57 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 1073741824" returned: 0 in 0.477s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:57 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.300s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Deleted volume successfully. Sep 28 12:35:57 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 Sep 28 12:35:57 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c6e09ec5-7b00-4012-ace4-b8a7db0951bc tempest-ProjectReaderTests-768350916 None] Lock "cinder-92f85dd9-606d-4a84-9ccc-3b95d83ed7dc-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:57 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" returned: 0 in 0.292s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0680557d-fa23-443f-8c57-3691973fc912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca4133-50a1-4704-baac-7ff88000bcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Volume volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 (8daeb320-69ff-4f64-8f5a-5a9b01b31bb2): created successfully Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca4133-50a1-4704-baac-7ff88000bcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Flow 'volume_create_manager' (3bb60a99-49bf-4fae-a817-97148ffa9da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:57 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-adfd96aa-0a26-4abb-a97f-b228919bdf3d tempest-ProjectReaderTests-758428822 None] Created volume successfully. Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Flow 'volume_create_manager' (8606049f-6f2c-454e-91f6-539002aedfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c92b49-e5be-4fd1-b829-44e98b763177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c92b49-e5be-4fd1-b829-44e98b763177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2008139863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed45986e-8927-4864-8825-a047347486f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd2f792c092450c93393c1b8144eaa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:58Z,use_quota=True,user_id='024b876b64e0404981c43400bbd63448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96961963-ef63-4388-a9ed-847c1da12c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96961963-ef63-4388-a9ed-847c1da12c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030fec0b-0656-4a1b-9987-b7a1aaf9a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030fec0b-0656-4a1b-9987-b7a1aaf9a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed45986e-8927-4864-8825-a047347486f4', 'volume_name': 'volume-ed45986e-8927-4864-8825-a047347486f4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ed6a88-9812-42fd-8fcb-34363e69c6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ed6a88-9812-42fd-8fcb-34363e69c6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4504871-1df8-463a-812e-7ff6a2f3a2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:57 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Volume ed45986e-8927-4864-8825-a047347486f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed45986e-8927-4864-8825-a047347486f4', 'volume_size': 1} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2008139863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed45986e-8927-4864-8825-a047347486f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd2f792c092450c93393c1b8144eaa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:58Z,use_quota=True,user_id='024b876b64e0404981c43400bbd63448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Creating volume ed45986e-8927-4864-8825-a047347486f4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:57 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:35:57 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:57 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 1073741824 Sep 28 12:35:57 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:58 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 1073741824" returned: 0 in 0.438s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:58 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 Sep 28 12:35:58 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:58 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4" returned: 0 in 0.249s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4504871-1df8-463a-812e-7ff6a2f3a2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed45986e-8927-4864-8825-a047347486f4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035cb7c2-0492-413f-84f1-56c2f9884d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:58 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Volume volume-ed45986e-8927-4864-8825-a047347486f4 (ed45986e-8927-4864-8825-a047347486f4): created successfully Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035cb7c2-0492-413f-84f1-56c2f9884d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Flow 'volume_create_manager' (8606049f-6f2c-454e-91f6-539002aedfeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:58 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-805fb21b-3aa7-4224-b697-5777dd8699a2 tempest-ProjectReaderTests-768350916 None] Created volume successfully. Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Acquiring lock "cinder-ed45986e-8927-4864-8825-a047347486f4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Lock "cinder-ed45986e-8927-4864-8825-a047347486f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Acquiring lock "cinder-quobyte-ed45986e-8927-4864-8825-a047347486f4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Lock "cinder-quobyte-ed45986e-8927-4864-8825-a047347486f4" acquired by "delete_volume" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f430dfa8-5028-467c-a298-c04444b1c75f]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:58 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 Sep 28 12:35:58 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Creating offline snapshot 9fb0403b-a9ca-4636-b358-30aa3684f176 of volume 8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 {{(pid=87167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bc0c89-297c-4774-86b7-9ec9f67a6d0c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:58 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:59 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 Sep 28 12:35:59 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:59 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4" returned: 0 in 0.391s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:59 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4 Sep 28 12:35:59 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:59 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" returned: 0 in 0.374s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 1G {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:59 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 1G Sep 28 12:35:59 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:59 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-ed45986e-8927-4864-8825-a047347486f4" returned: 0 in 0.259s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Lock "cinder-quobyte-ed45986e-8927-4864-8825-a047347486f4" released by "delete_volume" :: held 0.704s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Created reservations ['cb9d8c63-8dc1-4601-bf25-c3ecd08e8ca8', 'a4419714-a0cb-4b3b-831c-105fc46924b4', 'ef821e12-6937-4a89-a33e-8687ad53c538', '01432b98-ced5-409e-a32a-e2ceb049396f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:59 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:35:59 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:59 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 1G" returned: 0 in 0.433s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:59 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 Sep 28 12:35:59 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:59 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.293s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:59 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Deleted volume successfully. Sep 28 12:35:59 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-48c81b8c-b572-4af4-8f7f-3c41296e0928 tempest-ProjectReaderTests-768350916 None] Lock "cinder-ed45986e-8927-4864-8825-a047347486f4-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:00 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 -F qcow2 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176" returned: 0 in 0.328s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 is being set with open permissions: ugo+rw Sep 28 12:36:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:00 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 Sep 28 12:36:00 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:00 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176" returned: 0 in 0.246s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:00 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.info Sep 28 12:36:00 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:00 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.info" returned: 0 in 0.268s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:00 devstack cinder-volume[87167]: WARNING cinder.volume.drivers.remotefs [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.info is being set with open permissions: ugo+rw Sep 28 12:36:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.info {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:00 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.info Sep 28 12:36:00 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:00 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.info" returned: 0 in 0.283s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:00 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:00 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-74df9e7d-ed8d-4b15-ae3b-d21b3bf295b7 tempest-ProjectReaderTests-758428822 None] Create snapshot completed successfully Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-9fb0403b-a9ca-4636-b358-30aa3684f176-delete_snapshot" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Lock "cinder-9fb0403b-a9ca-4636-b358-30aa3684f176-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" by "delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-9fb0403b-a9ca-4636-b358-30aa3684f176" by "_delete_snapshot" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-9fb0403b-a9ca-4636-b358-30aa3684f176" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Deleting offline snapshot 9fb0403b-a9ca-4636-b358-30aa3684f176 of volume 8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] snapshot_file for this snap is: volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 {{(pid=87167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9d7cda-f7e5-42c0-94fb-76ea31a70eca]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:02 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 Sep 28 12:36:02 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:02 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176" returned: 0 in 0.401s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc80dbfa-9cae-4b94-8690-cb5ccaf64609]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:02 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 Sep 28 12:36:02 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:02 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" returned: 0 in 0.387s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:02 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:02 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 Sep 28 12:36:02 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:03 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176" returned: 0 in 0.360s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:03 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176 Sep 28 12:36:03 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:03 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:03 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2.9fb0403b-a9ca-4636-b358-30aa3684f176" returned: 0 in 0.254s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-9fb0403b-a9ca-4636-b358-30aa3684f176" released by "_delete_snapshot" :: held 1.509s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" released by "delete_snapshot" :: held 1.532s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:03 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Created reservations ['3f35ad87-77e2-42b5-93c1-a4a97952db27', 'eaa3c16f-fac2-48cd-a34a-7964a1d0ee71', 'd5414880-a1b9-4910-b24a-095696afaab3', '7a3d401a-6c94-4e33-b6bf-fac22da07f8c'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:36:03 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Delete snapshot completed successfully. Sep 28 12:36:03 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-0211c3f6-2516-4e76-b38b-560bd69cad20 tempest-ProjectReaderTests-758428822 None] Lock "cinder-9fb0403b-a9ca-4636-b358-30aa3684f176-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Lock "cinder-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Acquiring lock "cinder-quobyte-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:04 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:04 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8505e822-26fb-4dc8-8b2d-2c417ab7c4d1]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:36:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:04 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 Sep 28 12:36:04 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:04 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" returned: 0 in 0.415s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:04 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:04 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2 Sep 28 12:36:04 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:05 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" returned: 0 in 0.324s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Lock "cinder-quobyte-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2" released by "delete_volume" :: held 0.819s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Created reservations ['8b5c8600-8dec-40e3-a64b-892bc3697b9f', '73050fc8-2b9b-416e-af2a-f67a64b42284', '2660578a-edde-4307-a7e5-3934eb403998', '835a3e18-be97-4123-93ef-0874256e41a4'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:05 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:36:05 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:05 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.284s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:36:05 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Deleted volume successfully. Sep 28 12:36:05 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-dee6b5f9-63cb-4dce-9157-30cb8e1ce427 tempest-ProjectReaderTests-758428822 None] Lock "cinder-8daeb320-69ff-4f64-8f5a-5a9b01b31bb2-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Flow 'volume_create_manager' (8bfc3de0-8037-438f-86a9-e61f13a6aaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6151c484-4cfd-4b84-9163-8620a3bd9103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6151c484-4cfd-4b84-9163-8620a3bd9103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334439907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc65508-6d02-4a07-8c72-68a4af13f162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7b995716924bc690f1582bf8160ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:36:09Z,use_quota=True,user_id='fd54a59ae6fa4ff09513f5cdf670c3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee581c10-8dd7-4199-ae11-ab35470a2786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee581c10-8dd7-4199-ae11-ab35470a2786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5e3be7-7cc1-4bca-8f76-586bb2cc09dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5e3be7-7cc1-4bca-8f76-586bb2cc09dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc65508-6d02-4a07-8c72-68a4af13f162', 'volume_name': 'volume-3dc65508-6d02-4a07-8c72-68a4af13f162', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc033619-1b1b-43f2-b4d1-9de4c8f003b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc033619-1b1b-43f2-b4d1-9de4c8f003b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcbe1a3-156e-4f83-a6dc-60fe210b6bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:08 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Volume 3dc65508-6d02-4a07-8c72-68a4af13f162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc65508-6d02-4a07-8c72-68a4af13f162', 'volume_size': 1} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334439907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc65508-6d02-4a07-8c72-68a4af13f162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7b995716924bc690f1582bf8160ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:36:09Z,use_quota=True,user_id='fd54a59ae6fa4ff09513f5cdf670c3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Creating volume 3dc65508-6d02-4a07-8c72-68a4af13f162 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:36:08 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:36:08 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:08 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 1073741824 Sep 28 12:36:08 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:09 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 1073741824" returned: 0 in 0.499s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:09 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 Sep 28 12:36:09 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:09 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162" returned: 0 in 0.245s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcbe1a3-156e-4f83-a6dc-60fe210b6bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc65508-6d02-4a07-8c72-68a4af13f162', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83afee85-f83a-4116-9e90-0817a3a0614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:09 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Volume volume-3dc65508-6d02-4a07-8c72-68a4af13f162 (3dc65508-6d02-4a07-8c72-68a4af13f162): created successfully Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83afee85-f83a-4116-9e90-0817a3a0614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:09 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Flow 'volume_create_manager' (8bfc3de0-8037-438f-86a9-e61f13a6aaf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:36:09 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-cf512d72-9d64-4fb0-ad16-ab9fa19903e5 tempest-ProjectReaderTests-269519092 None] Created volume successfully. Sep 28 12:36:10 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Acquiring lock "cinder-3dc65508-6d02-4a07-8c72-68a4af13f162-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Lock "cinder-3dc65508-6d02-4a07-8c72-68a4af13f162-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Acquiring lock "cinder-quobyte-3dc65508-6d02-4a07-8c72-68a4af13f162" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Lock "cinder-quobyte-3dc65508-6d02-4a07-8c72-68a4af13f162" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[429e15f3-d20a-4ccf-9ce5-e115a514a98a]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:11 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 Sep 28 12:36:11 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:11 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162" returned: 0 in 0.391s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:11 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162 Sep 28 12:36:11 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:11 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-3dc65508-6d02-4a07-8c72-68a4af13f162" returned: 0 in 0.266s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Lock "cinder-quobyte-3dc65508-6d02-4a07-8c72-68a4af13f162" released by "delete_volume" :: held 0.710s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Created reservations ['fb1d80e6-7625-4733-a2c0-a7e19473da53', '3b03f294-2d57-49f8-b99c-7b151134fd15', '0ec3ed4c-6fef-4812-b2e9-a4ec94c39f22', '336131b7-8bbe-444b-a30e-97ce5a49104f'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:11 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:11 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:36:11 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:12 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.257s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:36:12 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Deleted volume successfully. Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-ec9d68ec-5af6-459a-8a6d-387494c46edb tempest-ProjectReaderTests-269519092 None] Lock "cinder-3dc65508-6d02-4a07-8c72-68a4af13f162-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Flow 'volume_create_manager' (52422972-0c2f-46d2-8b68-535c0fabfb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a28f66-bb52-433a-a4cf-797e1d49c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a28f66-bb52-433a-a4cf-797e1d49c192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882565100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7b995716924bc690f1582bf8160ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:36:13Z,use_quota=True,user_id='fd54a59ae6fa4ff09513f5cdf670c3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0037a6a3-2e55-4bd5-8d58-f38748273278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0037a6a3-2e55-4bd5-8d58-f38748273278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ab628d-c9a3-4690-b09a-a6d5e365a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ab628d-c9a3-4690-b09a-a6d5e365a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e', 'volume_name': 'volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b232d2c-c1fe-41e3-a10d-c337079d78e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b232d2c-c1fe-41e3-a10d-c337079d78e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdb0a19-ff8c-4946-8ebf-656a90a70a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:12 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Volume 9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e', 'volume_size': 1} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882565100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7b995716924bc690f1582bf8160ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:36:13Z,use_quota=True,user_id='fd54a59ae6fa4ff09513f5cdf670c3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Creating volume 9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:36:12 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:36:12 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:12 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e 1073741824 Sep 28 12:36:12 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:13 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e 1073741824" returned: 0 in 0.420s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:13 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e Sep 28 12:36:13 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:13 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e" returned: 0 in 0.237s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecdb0a19-ff8c-4946-8ebf-656a90a70a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be74c44-5f6d-42dd-bddf-a7bbb114299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:13 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Volume volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e (9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e): created successfully Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be74c44-5f6d-42dd-bddf-a7bbb114299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Flow 'volume_create_manager' (52422972-0c2f-46d2-8b68-535c0fabfb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:36:13 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-7d3e5a38-835c-4f94-bd95-8fb4a1b6423d tempest-ProjectReaderTests-269519092 None] Created volume successfully. Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Acquiring lock "cinder-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Lock "cinder-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Acquiring lock "cinder-quobyte-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Lock "cinder-quobyte-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e" acquired by "delete_volume" :: waited 0.014s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[804b7941-705f-4a01-9111-00011074fc34]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:36:13 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:13 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e Sep 28 12:36:13 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:14 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:14 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e Sep 28 12:36:14 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:14 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e" returned: 0 in 0.243s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Lock "cinder-quobyte-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e" released by "delete_volume" :: held 0.653s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Created reservations ['8974c115-a2f8-4282-a4f9-d4f41e669710', 'bb263df7-b901-40d2-83f4-abdecbc95c4f', '0166de64-24cf-4a84-9ede-f238c991027f', '8c889164-1995-4d40-bd34-44e7b0e2cc24'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:14 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:36:14 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:14 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.244s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:36:14 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Deleted volume successfully. Sep 28 12:36:14 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-aafb3d54-83a9-4935-a3fe-a0a1d289304c tempest-ProjectReaderTests-269519092 None] Lock "cinder-9f9d39d4-f63f-48ac-b0c5-b3bdab1c2f7e-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Flow 'volume_create_manager' (80a15796-5561-4f30-b41a-855bcf231deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119f555-a805-4ed2-8403-1c341ddcaa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119f555-a805-4ed2-8403-1c341ddcaa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249878407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e31d0b-1bfa-45d0-99e1-63b511a096be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7b995716924bc690f1582bf8160ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:36:15Z,use_quota=True,user_id='fd54a59ae6fa4ff09513f5cdf670c3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce66930-b064-4448-8ecc-d0e4fc1d5047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce66930-b064-4448-8ecc-d0e4fc1d5047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be938c60-2f52-44f8-a72a-f1298be0efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be938c60-2f52-44f8-a72a-f1298be0efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e31d0b-1bfa-45d0-99e1-63b511a096be', 'volume_name': 'volume-11e31d0b-1bfa-45d0-99e1-63b511a096be', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ba4efe-9b54-4d24-9383-fe71d19115ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ba4efe-9b54-4d24-9383-fe71d19115ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30187684-5a94-4cf1-a439-0407c780f939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:15 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Volume 11e31d0b-1bfa-45d0-99e1-63b511a096be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e31d0b-1bfa-45d0-99e1-63b511a096be', 'volume_size': 1} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249878407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e31d0b-1bfa-45d0-99e1-63b511a096be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7b995716924bc690f1582bf8160ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:36:15Z,use_quota=True,user_id='fd54a59ae6fa4ff09513f5cdf670c3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Creating volume 11e31d0b-1bfa-45d0-99e1-63b511a096be {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:36:15 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:15 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be 1073741824 Sep 28 12:36:15 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:15 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be 1073741824" returned: 0 in 0.396s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:15 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:15 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be Sep 28 12:36:15 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:16 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be" returned: 0 in 0.241s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30187684-5a94-4cf1-a439-0407c780f939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e31d0b-1bfa-45d0-99e1-63b511a096be', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcc1a0d-31a6-4411-b82d-72f3a9b987d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:16 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Volume volume-11e31d0b-1bfa-45d0-99e1-63b511a096be (11e31d0b-1bfa-45d0-99e1-63b511a096be): created successfully Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcc1a0d-31a6-4411-b82d-72f3a9b987d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Flow 'volume_create_manager' (80a15796-5561-4f30-b41a-855bcf231deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:36:16 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-d0e0abbb-0c48-421d-8dc1-7911d0ac8f2e tempest-ProjectReaderTests-269519092 None] Created volume successfully. Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Acquiring lock "cinder-11e31d0b-1bfa-45d0-99e1-63b511a096be-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Lock "cinder-11e31d0b-1bfa-45d0-99e1-63b511a096be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Acquiring lock "cinder-quobyte-11e31d0b-1bfa-45d0-99e1-63b511a096be" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Lock "cinder-quobyte-11e31d0b-1bfa-45d0-99e1-63b511a096be" acquired by "delete_volume" :: waited 0.017s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3846dfa-071a-40bc-b4d9-d90f204dbe35]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:16 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be Sep 28 12:36:16 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:16 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be" returned: 0 in 0.361s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:16 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:16 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be Sep 28 12:36:16 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:17 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-11e31d0b-1bfa-45d0-99e1-63b511a096be" returned: 0 in 0.236s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Lock "cinder-quobyte-11e31d0b-1bfa-45d0-99e1-63b511a096be" released by "delete_volume" :: held 0.641s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Created reservations ['77fb5464-8e8a-439d-b122-1d055787efef', '770d7a34-e173-49b0-8577-8f08d39ea302', '45c55b07-9c39-4742-b095-85d12eb579eb', '1d80de7d-0546-47b6-87f1-1a585a25074a'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:17 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:36:17 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:17 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.244s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:36:17 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Deleted volume successfully. Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-33f71c3b-7f48-4dc9-8f63-98dbd9559303 tempest-ProjectReaderTests-269519092 None] Lock "cinder-11e31d0b-1bfa-45d0-99e1-63b511a096be-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.flows.manager.create_volume [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Flow 'volume_create_manager' (c760b8f3-8202-413a-a3cd-09e82e660b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3906789a-e192-406b-9644-642f36e5f29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3906789a-e192-406b-9644-642f36e5f29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088446898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f02f0ad-d2ac-468e-a2a2-5008c68438a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7b995716924bc690f1582bf8160ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:36:18Z,use_quota=True,user_id='fd54a59ae6fa4ff09513f5cdf670c3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc30f50c-9398-47e1-83ca-0a53466de0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc30f50c-9398-47e1-83ca-0a53466de0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce62909-6790-44e5-a3db-1f828e0c4d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce62909-6790-44e5-a3db-1f828e0c4d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f02f0ad-d2ac-468e-a2a2-5008c68438a4', 'volume_name': 'volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac97aeac-d343-493a-a4df-9f8f7f770ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac97aeac-d343-493a-a4df-9f8f7f770ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c756b329-1ed8-48c1-aa7f-df48c03b430c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:17 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Volume 5f02f0ad-d2ac-468e-a2a2-5008c68438a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4', 'volume_size': 1} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1088446898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f02f0ad-d2ac-468e-a2a2-5008c68438a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7b995716924bc690f1582bf8160ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:36:18Z,use_quota=True,user_id='fd54a59ae6fa4ff09513f5cdf670c3a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5f4cabf-3fc1-4272-b457-7dbac2b8106f),volume_type_id=b5f4cabf-3fc1-4272-b457-7dbac2b8106f)}" {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.remotefs [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Creating volume 5f02f0ad-d2ac-468e-a2a2-5008c68438a4 {{(pid=87167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:17 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Selected osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe as target Quobyte volume. {{(pid=87167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:36:18 devstack cinder-volume[87167]: INFO cinder.volume.drivers.remotefs [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] casted to osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 1073741824 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:18 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 1073741824 Sep 28 12:36:18 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:18 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 1073741824" returned: 0 in 0.419s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:18 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 Sep 28 12:36:18 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:18 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4" returned: 0 in 0.248s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'} {{(pid=87167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c756b329-1ed8-48c1-aa7f-df48c03b430c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4', 'volume_size': 1}' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3f9199-a013-4537-b1d3-b4852cbb21d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:36:18 devstack cinder-volume[87167]: INFO cinder.volume.flows.manager.create_volume [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Volume volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 (5f02f0ad-d2ac-468e-a2a2-5008c68438a4): created successfully Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3f9199-a013-4537-b1d3-b4852cbb21d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87167) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Flow 'volume_create_manager' (c760b8f3-8202-413a-a3cd-09e82e660b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87167) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:36:18 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-24288335-0e99-4c6a-aad3-eacf9e1ea168 tempest-ProjectReaderTests-269519092 None] Created volume successfully. Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Acquiring lock "cinder-5f02f0ad-d2ac-468e-a2a2-5008c68438a4-delete_volume" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:18 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Lock "cinder-5f02f0ad-d2ac-468e-a2a2-5008c68438a4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Acquiring lock "cinder-quobyte-5f02f0ad-d2ac-468e-a2a2-5008c68438a4" by "delete_volume" {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Lock "cinder-quobyte-5f02f0ad-d2ac-468e-a2a2-5008c68438a4" acquired by "delete_volume" :: waited 0.015s {{(pid=87167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f720f3f4-c4a3-441e-aefd-fa067a84831c]: (4, 'qcow2') {{(pid=87898) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:19 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 Sep 28 12:36:19 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:19 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4" returned: 0 in 0.366s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:19 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4 Sep 28 12:36:19 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:19 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7/volume-5f02f0ad-d2ac-468e-a2a2-5008c68438a4" returned: 0 in 0.265s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Lock "cinder-quobyte-5f02f0ad-d2ac-468e-a2a2-5008c68438a4" released by "delete_volume" :: held 0.676s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG cinder.quota [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Created reservations ['9ad03f90-6f12-4182-b7ad-b6efa1450670', '51606bee-4ba8-4947-bcff-6dc187669659', '8bfce407-40c8-47ed-9c73-58703cb77da7', 'ca8a0f1a-4232-4f74-b36a-114417f524ca'] {{(pid=87167) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:19 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:19 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:36:19 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:20 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:20 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.236s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:20 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:36:20 devstack cinder-volume[87167]: INFO cinder.volume.manager [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Deleted volume successfully. Sep 28 12:36:20 devstack cinder-volume[87167]: DEBUG cinder.coordination [None req-c4d5bf27-4ee1-48c9-b675-00e9c1219769 tempest-ProjectReaderTests-269519092 None] Lock "cinder-5f02f0ad-d2ac-468e-a2a2-5008c68438a4-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87167) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:36:29 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:SELECT=75,cinder:INSERT=30,cinder:UPDATE=106,cinder:DELETE=10 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:36:30 devstack cinder-volume[87167]: DEBUG dbcounter [-] [87167] Writing DB stats cinder:INSERT=24,cinder:UPDATE=113,cinder:SELECT=71,cinder:DELETE=9 {{(pid=87167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe': None} {{(pid=87167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG cinder.volume.drivers.quobyte [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b8b3ebae-1442-4cd0-9e20-8563c31ee9fe'] {{(pid=87167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.lockutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87167) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:36:49 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7 Sep 28 12:36:49 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:36:49 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG oslo_concurrency.processutils [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9f3714a7bd6f04632662a8113525a0a7" returned: 0 in 0.239s {{(pid=87167) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG cinder.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Notifying Schedulers of capabilities ... {{(pid=87167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG oslo_service.periodic_task [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] Running periodic task VolumeManager._thread_info {{(pid=87167) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread count: 28 {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:36:49 devstack cinder-volume[87167]: DEBUG cinder.volume.manager [None req-d3183f2d-520b-49e0-9b2a-936fd3e9d49d None None] thread info: [<_MainThread(MainThread, started 124611301679232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87167) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}